-- Logs begin at Fri 2021-09-24 02:54:46 UTC, end at Fri 2021-09-24 03:51:15 UTC. -- Sep 24 03:22:50.444736 dv-cinder-810800-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 24 03:22:50.452232 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 24 03:22:50 2021] *** Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: nodename: dv-cinder-810800-1-iscsi Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: machine: x86_64 Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: clock source: unix Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: pcre jit disabled Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: detected number of CPU cores: 4 Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: current working directory: / Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: detected binary path: /usr/bin/uwsgi-core Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: your processes number limit is 47680 Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: your memory page size is 4096 bytes Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: detected max file descriptor number: 2048 Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: lock engine: pthread robust mutexes Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: thunder lock: enabled Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 24 03:22:50.456449 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 24 03:22:50.500861 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: Python main interpreter initialized at 0x55ff90ae89c0 Sep 24 03:22:50.500861 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: python threads support enabled Sep 24 03:22:50.500861 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: your server socket listen backlog is limited to 100 connections Sep 24 03:22:50.500861 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: your mercy for graceful operations on workers is 90 seconds Sep 24 03:22:50.501882 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 03:22:50.502053 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: *** Operational MODE: preforking *** Sep 24 03:22:50.502283 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: *** uWSGI is running in multiple interpreter mode *** Sep 24 03:22:50.502283 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: spawned uWSGI master process (pid: 93323) Sep 24 03:22:50.502497 dv-cinder-810800-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 24 03:22:50.505357 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: spawned uWSGI worker 1 (pid: 93324, cores: 1) Sep 24 03:22:50.505357 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: spawned uWSGI worker 2 (pid: 93325, cores: 1) Sep 24 03:22:50.505357 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 03:22:52.154294 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 03:22:52.154294 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: from cryptography.utils import int_from_bytes Sep 24 03:22:52.154955 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 03:22:52.154955 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: from cryptography.utils import int_from_bytes Sep 24 03:22:52.181279 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 03:22:52.181279 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: from cryptography.utils import int_from_bytes Sep 24 03:22:52.181830 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 03:22:52.181830 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: from cryptography.utils import int_from_bytes Sep 24 03:22:54.932644 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 03:22:54.933091 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 03:22:54.933350 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 03:22:54.933731 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 03:22:54.933988 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 03:22:54.934369 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.934455 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 03:22:54.934800 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 03:22:54.934875 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.935024 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.935125 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 03:22:54.935304 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.935454 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 03:22:54.935630 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.935726 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 03:22:54.935943 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.936071 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.936258 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.936393 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.936573 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.936711 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.936897 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.937024 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.937153 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.937350 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.937448 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.937656 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.937793 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810800-1-iscsi {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.937999 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.938114 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.938910 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.939009 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.939262 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.939346 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.939521 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.939605 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.939832 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.939918 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.940153 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810800-1-iscsi {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.940244 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.940471 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.940555 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.940771 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.940969 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.941075 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.941376 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.941492 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.941682 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.941826 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.942014 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.942132 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.942314 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.942431 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.942645 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.942809 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.942943 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.943115 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.943251 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.943415 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.943561 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.943717 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.943878 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.944046 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.944183 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.944353 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.944574 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810800-1-iscsi {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.944658 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.944887 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.944982 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.945195 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.945282 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.945508 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.945650 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.945863 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.946034 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.946241 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.946370 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810800-1-iscsi {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.946548 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.946687 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.946850 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.946987 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.947156 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.947295 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.947463 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.947548 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.947785 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.947872 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.948102 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.948194 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.948418 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.948510 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.948734 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.948817 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.949033 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.949119 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.949338 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.949422 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.949644 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.949753 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.949984 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.950128 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.950289 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.950383 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.950586 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.950669 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.950828 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.950993 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.951123 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.951216 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.951443 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.951540 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.951759 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.951845 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.952067 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.952150 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.952316 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.952408 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.952564 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.952650 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.952879 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.952964 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.953197 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.953298 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.953508 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.953592 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.953784 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.953872 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.954635 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.954724 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.954953 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.955089 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.955272 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.955370 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.955576 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.955660 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.955879 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.955969 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.956181 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.956276 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.956483 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.956568 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.956786 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.956871 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.957090 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.957183 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.957391 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.957476 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.957696 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.957812 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.958034 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.958132 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.958344 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.958426 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.958647 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.958731 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.958951 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.959042 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.959269 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.959360 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.959578 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.959662 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.959894 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.959978 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.960198 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.960282 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.960499 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.960582 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.960803 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.960895 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.961106 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.961196 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.961425 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.961509 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.961765 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.961854 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.962071 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.962154 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.962320 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.962403 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.962619 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.962704 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.962920 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.963004 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.963235 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.963327 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.963543 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.963626 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.963795 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.963888 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.964095 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.964187 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.964397 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.964487 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.964707 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.964797 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.965008 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.965100 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.965308 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.965401 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.965609 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.965692 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.965933 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.966032 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.966233 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.966317 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.966536 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.966628 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.966835 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.966930 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.967136 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.967221 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.967442 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.967532 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.967743 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.967828 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.968045 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.968128 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.968345 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.968433 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.968640 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.968724 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.968949 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.969058 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.969255 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.969340 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.969579 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.969665 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.969906 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.970046 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.970209 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.970296 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.970513 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.970606 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.970811 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.970896 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.971119 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.971202 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.971419 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.971504 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.971721 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.971805 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.972030 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.972120 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.972327 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.972413 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.972631 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.972716 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.972931 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.973015 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.973234 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.973320 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.973541 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.973630 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.973860 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.973958 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.974159 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.974244 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.974461 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.974554 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.974760 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.974849 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.975056 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.975141 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.975351 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.975484 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.975647 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.975739 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.975945 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.976069 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.976244 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.976370 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.976542 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.976636 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.976841 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.976925 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.977137 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.977221 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.977450 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.977609 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.977785 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.977873 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.978092 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.978269 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.978395 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.978495 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.978696 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.978781 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.979009 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:22:54.979105 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.979338 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.979424 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.979665 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.979757 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.979973 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.980064 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.980284 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.980376 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.980607 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.980691 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.980916 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.981000 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.981224 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.981310 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.981530 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.981613 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.981869 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.981969 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.982183 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.982267 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.982488 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.982571 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.982796 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.982888 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.983103 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.983187 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.983417 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.983511 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.983722 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.983806 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.984035 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.984121 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.984341 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.984425 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.984652 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.984744 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.984959 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.985044 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.985302 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.985486 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.985614 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.985867 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.985963 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.986050 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.986263 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.986365 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.986570 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.986667 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.986884 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.986971 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.987193 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.987278 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.987504 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.987597 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.987814 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.987900 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.988122 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.988207 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.988427 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.988518 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.988733 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.988825 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.989042 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.989127 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.989349 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.989442 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.989659 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.989798 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.989990 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.990082 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.990289 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.990374 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.990592 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.990677 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.990897 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.990981 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.991196 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.991293 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.991503 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.991589 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.991811 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.991903 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.992113 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.992204 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.992416 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.992509 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.992718 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.992811 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.993023 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.993113 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.993328 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.993413 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.993634 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.993743 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.993965 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.994058 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.994273 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.994358 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.994575 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.994672 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.994877 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.994961 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.995179 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.995263 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.995478 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.995570 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.995784 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.995874 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.996085 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.996169 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.996383 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.996471 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.996693 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.996781 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.997245 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.997337 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.997549 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.997635 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.997878 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.997965 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.998184 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.998269 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.998494 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.998580 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.998798 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.998883 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.999104 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.999189 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.999411 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.999497 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.999728 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:54.999820 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.000034 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.000127 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.000340 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.000435 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.000658 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.001310 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.001547 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.001648 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.001859 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.001972 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.002163 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.002303 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.002464 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.002625 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.002767 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.002941 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.003074 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.003244 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.003377 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.003549 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.003679 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.003848 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.003985 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.004149 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.004287 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.004451 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.004588 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.004755 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.004909 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.005055 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.005215 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.005355 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.005516 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.005655 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.005840 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.005981 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.006139 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.006281 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.006477 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.006598 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.006778 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.006904 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.007115 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.007202 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.007450 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.007541 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.007766 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.007854 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.008087 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.008174 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.008383 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.008466 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.008697 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.008788 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.009004 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.009090 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.009311 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.009395 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.009618 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.009742 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.009950 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.010046 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.010260 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.010344 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.010565 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.010658 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.010872 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.010957 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.011178 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.011263 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.011482 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.011574 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.011795 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.011885 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.012098 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.012188 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.012403 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.012495 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.012712 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.012808 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.013031 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.013116 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.013337 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.013431 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.013651 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.013754 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.013980 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.014066 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.014291 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.014385 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.014606 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.014689 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.014911 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.014995 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.015217 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.015302 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.015522 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.015606 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.015827 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.015949 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.016133 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.016218 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.016998 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.017135 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.017419 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.017563 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.017762 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.017905 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.018075 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.018215 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.018383 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.018531 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.018702 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.018839 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.019005 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.019157 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.019317 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.019461 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.019642 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.019780 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.019971 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.020086 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.020276 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.020401 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.020587 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.020702 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.020906 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.020999 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.021213 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.021307 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.021520 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.021631 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.021849 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.021960 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.022151 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.022267 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.022452 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.022590 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.022759 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.022896 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.023072 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.023201 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.023378 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.023505 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.023683 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.023801 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.023992 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.024085 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.024301 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.024389 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.024604 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.024690 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.024904 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.024990 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.025203 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.025334 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.025511 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.025603 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.025858 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.025950 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.026161 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.026253 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.026460 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.026542 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.026760 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.026845 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.027065 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.027187 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.027367 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.027453 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.027674 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.027760 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.027978 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.028062 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.028280 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.028373 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.028581 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.028673 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.028879 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.028964 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.029193 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.029290 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.029498 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.029583 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.029821 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.029909 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.030124 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.030283 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.030422 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.030507 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.030730 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.030823 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.031041 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.031135 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.031338 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.031422 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.031641 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.031725 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.031953 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.032093 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.032400 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.032898 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.033215 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.033525 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.033874 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.033963 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.034187 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.034274 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.034494 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.034580 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.034803 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.034889 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.035110 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.035195 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.035419 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.035505 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.035728 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.035815 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.036047 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.036138 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.036355 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.036452 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.036663 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.036749 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.036967 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.037051 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.037267 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.037359 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.037574 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.037659 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.037923 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.038164 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.038486 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.038591 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.038795 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.038881 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.039110 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.039195 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.039422 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.039515 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.039734 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.039819 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.040046 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.040131 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.040372 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.040458 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.040678 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.040769 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.040980 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.041065 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.041279 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.041367 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.041580 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.041663 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.041904 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.041991 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.042204 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.042290 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.042504 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.042594 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.042802 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.042886 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.043104 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.043195 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.043403 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.043488 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.043702 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.043792 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.044001 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.044092 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.044300 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.044384 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.044598 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.044695 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.044895 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.044993 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.045197 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.045282 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.045494 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.045587 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.045822 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.045912 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.046125 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.046217 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.046436 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.046520 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.046736 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.046822 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.047032 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.047117 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.047329 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.047413 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.047684 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.047779 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.048086 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.048234 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.048526 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.048617 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.048857 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.048954 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.049182 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.049266 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.049489 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.049579 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.049819 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.049918 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.050126 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.050210 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.050433 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.050517 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.050735 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.050828 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.051036 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.051118 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.051339 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.051430 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.051640 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.051732 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.051941 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.052031 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.052240 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.052326 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.052543 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.052628 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.052849 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.052933 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.053151 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.053241 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.053447 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.053532 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.053774 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.053876 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.054078 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.054164 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.054389 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.054475 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.054693 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.054778 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.054992 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.055077 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.055289 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.055377 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.055589 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.055674 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.055890 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.055973 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.056190 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.056276 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.056489 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.056574 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.056782 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.056915 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.057075 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.057167 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.057382 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.057510 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.057680 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.057810 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.058002 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.058094 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.058300 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.058385 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.058601 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.058698 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.058902 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.058988 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.059199 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.059284 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.059510 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.059602 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.059810 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.059902 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.060105 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.060193 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.060403 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.060496 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.060700 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.060785 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.060996 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.061082 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.061298 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.061384 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.061614 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.061699 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.061949 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.062035 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.062249 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.062337 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.062558 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.062644 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.062856 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.062940 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.063154 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.063785 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.064009 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.064144 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.064311 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.064398 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.064610 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.064698 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.064906 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.064989 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.065199 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.065283 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.065500 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.065585 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.065819 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.065907 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.066139 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.066242 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.066435 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.066520 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.066730 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.066814 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.067025 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.067121 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.067318 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.067409 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.067652 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.067737 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.067952 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.068045 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.068294 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.068378 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.068594 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.068691 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.068902 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.069017 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.069207 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.069291 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.069509 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.069600 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.069838 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.069941 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.070141 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.070224 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.070436 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.070520 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.070744 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.070838 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.071050 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.071142 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.071346 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.071429 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.071643 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.071728 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.071943 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.072029 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.072253 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.072401 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.072558 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.072644 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.072867 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.072953 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.073185 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.073269 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.073501 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.073587 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.073838 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.073929 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.074148 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.074251 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.074450 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.074541 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.074752 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.074845 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.075055 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.075151 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.075358 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.075442 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.075660 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.075751 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.075967 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.076061 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.076272 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.076394 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.076575 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.076695 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.076879 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.076973 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.077182 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.077275 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.077482 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.077573 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.077805 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.077909 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.078110 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.078201 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.078421 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.078517 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.078724 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.078809 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.079568 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.079670 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.079937 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.080022 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.080243 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.080328 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.080549 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.080635 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.080852 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.080936 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.081153 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.081276 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.081575 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.081661 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.081907 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.081993 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.082211 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.082303 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.082511 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.082598 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.082822 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.082960 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.083129 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.083220 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.083438 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.083521 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.083742 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.083840 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.084043 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.084156 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.084455 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.084540 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.084760 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.084918 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.085066 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.085152 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.085367 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.085450 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.085667 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.085814 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.085995 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.086081 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.086301 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.086386 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.086622 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.086720 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.086923 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.087020 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.087225 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.087310 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.087526 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.087613 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.087827 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.087911 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.088131 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.088215 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.088448 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.088534 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.088832 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.088917 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.089136 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.089222 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.089437 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.089545 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.089876 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.089964 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.090182 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.090265 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.090488 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.090575 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.090803 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.090887 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.091134 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.091236 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.091417 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.091501 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.091721 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.091805 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.092025 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.092117 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.092324 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.092408 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.092644 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.092728 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.092950 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.093042 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.093259 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.093350 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.093561 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.093645 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.093885 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.093985 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.094204 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.094290 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.094565 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.094696 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.094871 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.094991 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.095189 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.095514 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.095602 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.095839 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.095933 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.096151 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.096257 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.096469 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.096556 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.096793 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.096885 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.097096 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.097190 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.097397 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.097482 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.097701 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.097805 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.098026 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.098129 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.098329 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.098413 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.098644 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.098729 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.098945 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.099039 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.099251 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.099336 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.099555 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.099640 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.099858 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.099950 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.100158 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.100242 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.100454 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.100538 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.100771 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.100864 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.101067 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.101152 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.101386 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.101472 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.101694 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.101843 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.102034 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.102120 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.102349 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.102443 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.102651 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.102737 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.102970 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.103055 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.103274 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.103359 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.103571 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.103663 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.103870 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.103954 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.104165 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.104249 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.104502 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.104587 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.104800 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.104892 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.105115 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.105208 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.105437 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.105529 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.105783 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.105871 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.106091 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.106185 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.106418 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.106504 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.106738 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.106823 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.107049 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.107146 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.107360 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.107490 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.107679 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.107765 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.107979 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.108072 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.108275 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.108359 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.108577 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.108667 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.108875 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.108967 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.109172 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.109256 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.109470 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.109562 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.109795 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.109883 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.110115 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.110261 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.110432 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.110519 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.110732 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.110820 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.111051 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.111137 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.111352 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.111438 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.111671 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.111758 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.111975 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.112061 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.112275 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.112360 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.112578 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.112665 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.112873 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.112959 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.113210 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.113307 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.113508 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.113592 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.113861 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.113951 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.114175 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.114276 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.114494 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.114581 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.114815 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.114899 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.115119 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.115212 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.115438 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.115522 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.115751 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.115836 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.116060 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.116154 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.116368 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.116453 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.116676 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.116761 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.116984 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.117069 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.117291 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.117382 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.117599 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.117684 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.117929 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.118016 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.118239 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.118327 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.118548 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.118633 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.118857 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.118949 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.119368 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.119454 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.119691 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.119775 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.120000 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.120086 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.120308 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.120393 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.120614 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.120707 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.120921 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.121006 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.121227 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.121312 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.121533 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.121627 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.121861 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.122202 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.122424 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.122509 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.122726 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.122824 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.123048 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.123134 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.123365 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.123452 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.123685 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.123771 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.124013 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.124099 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.124324 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.124418 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.124634 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.124721 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.124941 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.125025 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.125249 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.125333 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.125598 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.125688 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.126492 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.126579 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.126829 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.126981 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.127142 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.127228 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.127451 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.127536 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.127762 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.127859 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.128072 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.128158 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.128382 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.128467 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.128695 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.128789 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.129004 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.129090 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.129310 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.129396 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.129615 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.129703 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.129950 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.130035 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.130258 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.130343 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.130578 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.130664 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.130905 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.130990 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.131220 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.131314 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.131529 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.131614 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.131837 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.131929 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.132148 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.132303 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.132659 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.132747 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.132966 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.133050 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.133292 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.133385 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.133612 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.133696 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.133956 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.134041 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.134267 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.134363 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.134578 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.134662 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.134902 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.134988 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.135203 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.135289 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.135502 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.135585 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.135809 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.135893 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.136109 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.136194 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.136409 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.136494 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.136725 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.136809 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.137027 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.137113 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.137324 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.137416 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.137633 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.137742 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.137962 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.138051 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.138490 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.138575 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.138831 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.138924 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.139143 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.139228 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.139463 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.139547 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.139782 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.139940 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.140093 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.140179 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.140394 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.140479 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.140713 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.140809 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.141014 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.141099 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.141314 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.141469 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.142268 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.142370 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.142580 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.142761 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.142885 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.143073 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.143188 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.143380 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.143505 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.143693 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.143811 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.144002 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.144117 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.144307 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.144423 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.144617 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.144724 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.144922 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.145047 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.145247 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.145335 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.145555 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.145640 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.145884 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.145985 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.146198 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.146291 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.146510 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.146597 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.146813 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.146906 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.147118 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.147204 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.147417 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.147509 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.147718 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.147816 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.148019 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.148103 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.148321 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.148444 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.148622 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.148709 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.148924 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.149015 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.149221 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.149306 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.149524 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.149610 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.149848 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.149949 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.150152 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.150237 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.150457 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.150542 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.150758 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.150843 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.151056 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.151140 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.151362 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.151460 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.151668 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.151753 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.151977 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.152068 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.152284 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.152369 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.152591 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.152676 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.152922 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.153014 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.153232 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.153454 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.153786 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.153878 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.154124 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.154226 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.154459 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.154545 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.154800 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.154971 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.155139 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.155283 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.155448 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.155590 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.155755 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.155895 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.156065 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.156215 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.156385 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.156525 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.156695 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.156832 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.157041 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.157193 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.157357 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.157480 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.157664 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.157872 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.157997 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.158183 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.158306 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.158493 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.158659 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.158800 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.159107 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.159195 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.159413 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.159499 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.159745 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.159838 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.160059 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.160145 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.160371 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.160457 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.160683 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.160775 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.160991 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.161076 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.161298 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.161383 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.161603 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.161697 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.161934 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.162019 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.162242 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.162327 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.162557 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.162654 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.162867 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.162953 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.163170 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.163257 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.163471 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.163587 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.163880 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.163965 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.164189 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.164274 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.164503 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.164589 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.164808 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.164893 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.165113 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.165198 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.165436 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.165523 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.165760 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.165879 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.166082 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.166177 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.166391 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.166479 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.166698 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.166782 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.167026 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.167119 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.167348 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.167434 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.167667 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.167753 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.167971 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.168071 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.168273 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.168362 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.168574 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.168702 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.168882 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.168984 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.169173 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.169258 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.169494 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.169579 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.169824 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.169938 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.170131 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.170216 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.170441 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.170528 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.170742 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.170829 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.171056 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.171142 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.171370 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.171455 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.171683 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.171770 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.171989 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.172078 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.172294 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.172391 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.172647 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.172740 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.172961 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.173148 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.173338 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.173466 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.173679 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.173843 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.174014 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.174130 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.174322 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.174422 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.174646 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.174733 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.174969 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.175055 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.175272 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.175366 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.175594 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.175680 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.175909 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.176002 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.176224 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.176312 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.176537 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.176627 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.176846 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.176932 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.177152 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.177238 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.177466 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.177550 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.177801 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.177892 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.178113 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.178209 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.178463 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.178559 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.178726 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.178821 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.179033 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.179125 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.179344 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.179429 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.179664 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.179761 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.179986 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.180071 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.180305 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.180389 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.180625 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.180718 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.180942 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.181027 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.181265 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.181350 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.181589 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.181682 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.181853 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 03:22:55.181942 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:22:55.182168 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 03:22:55.205242 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_db.sqlalchemy.engines [None req-7402e646-6d2e-4d05-b23f-1fc8f0bb0ea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93325) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:22:55.206122 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG oslo_db.sqlalchemy.engines [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:22:55.380146 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.context [None req-7402e646-6d2e-4d05-b23f-1fc8f0bb0ea5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05fe9a5b-3028-4ccf-ab58-a247bdca46d5(cell1) {{(pid=93325) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 03:22:55.380359 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.context [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05fe9a5b-3028-4ccf-ab58-a247bdca46d5(cell1) {{(pid=93324) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 03:22:55.384747 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG oslo_concurrency.lockutils [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:22:55.386368 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG oslo_concurrency.lockutils [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:22:55.387172 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG oslo_concurrency.lockutils [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:22:55.389394 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG oslo_concurrency.lockutils [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:22:55.390447 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-7402e646-6d2e-4d05-b23f-1fc8f0bb0ea5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:22:55.392128 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-7402e646-6d2e-4d05-b23f-1fc8f0bb0ea5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:22:55.393026 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-7402e646-6d2e-4d05-b23f-1fc8f0bb0ea5 None None] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:22:55.395085 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-7402e646-6d2e-4d05-b23f-1fc8f0bb0ea5 None None] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:22:55.400218 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG oslo_db.sqlalchemy.engines [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:22:55.402557 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG oslo_db.sqlalchemy.engines [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:22:55.409398 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_db.sqlalchemy.engines [None req-7402e646-6d2e-4d05-b23f-1fc8f0bb0ea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93325) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:22:55.411499 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_db.sqlalchemy.engines [None req-7402e646-6d2e-4d05-b23f-1fc8f0bb0ea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93325) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:22:55.665215 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG oslo_db.sqlalchemy.engines [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:22:55.683089 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_db.sqlalchemy.engines [None req-7402e646-6d2e-4d05-b23f-1fc8f0bb0ea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93325) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:22:56.007609 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: WARNING keystonemiddleware.auth_token [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 03:22:56.011444 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: WARNING keystonemiddleware.auth_token [None req-7402e646-6d2e-4d05-b23f-1fc8f0bb0ea5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 03:22:56.014077 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: WARNING keystonemiddleware.auth_token [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 03:22:56.019434 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: WARNING keystonemiddleware.auth_token [None req-7402e646-6d2e-4d05-b23f-1fc8f0bb0ea5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 03:22:56.357843 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: WARNING keystonemiddleware.auth_token [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 03:22:56.362944 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: WARNING keystonemiddleware.auth_token [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 03:22:56.368963 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff90ae89c0 pid: 93324 (default app) Sep 24 03:22:56.371015 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:22:56.372451 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001702 Sep 24 03:22:56.372856 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 789 bytes} [Fri Sep 24 03:22:56 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:22:56.389791 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: WARNING keystonemiddleware.auth_token [None req-7402e646-6d2e-4d05-b23f-1fc8f0bb0ea5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 03:22:56.396559 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: WARNING keystonemiddleware.auth_token [None req-7402e646-6d2e-4d05-b23f-1fc8f0bb0ea5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 03:22:56.401678 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff90ae89c0 pid: 93325 (default app) Sep 24 03:24:17.473427 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:17.474471 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 24 03:24:17.475036 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:24:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:24:17.916913 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-ed64268f-6df8-4ad5-82f2-6b3a8cc55643 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:17.946658 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-ed64268f-6df8-4ad5-82f2-6b3a8cc55643 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.464417 Sep 24 03:24:17.947583 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1292 bytes} [Fri Sep 24 03:24:17 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:24:20.159660 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:20.160574 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-d1d74a3d-c4e8-4861-b6e7-910975210622 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Sep 24 03:24:20.160986 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:24:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:24:20.225891 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-27b78b7d-9623-4a0f-affd-77d21cd7e2fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "vcpus": 1}} {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:20.244352 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:24:20.244352 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: warnings.warn(msg) Sep 24 03:24:20.276420 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-27b78b7d-9623-4a0f-affd-77d21cd7e2fc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108696 Sep 24 03:24:20.277164 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1283 bytes} [Fri Sep 24 03:24:20 2021] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:24:20.501193 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-69e96490-ef59-42f7-944b-a66ddbe143da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:20.503531 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:24:20.503531 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: warnings.warn(msg) Sep 24 03:24:20.550722 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-69e96490-ef59-42f7-944b-a66ddbe143da admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.264774 Sep 24 03:24:20.551498 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1336 bytes} [Fri Sep 24 03:24:20 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:24:22.819400 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-27b78b7d-9623-4a0f-affd-77d21cd7e2fc admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:22.820339 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-27b78b7d-9623-4a0f-affd-77d21cd7e2fc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 24 03:24:22.820744 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:24:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:24:22.929435 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-591c1ad4-c0e5-459d-bd77-8bf4629e7cf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "id": "d1"}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:22.947459 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:24:22.947459 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: warnings.warn(msg) Sep 24 03:24:22.965548 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-591c1ad4-c0e5-459d-bd77-8bf4629e7cf4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137338 Sep 24 03:24:22.966130 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1283 bytes} [Fri Sep 24 03:24:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:24:22.978882 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-1371ab2e-1a58-477d-bce6-af1cf9fdbfa7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:22.980336 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:24:22.980336 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: warnings.warn(msg) Sep 24 03:24:23.016514 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-1371ab2e-1a58-477d-bce6-af1cf9fdbfa7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041169 Sep 24 03:24:23.017342 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1336 bytes} [Fri Sep 24 03:24:22 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:24:25.290190 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-591c1ad4-c0e5-459d-bd77-8bf4629e7cf4 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:25.291205 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-591c1ad4-c0e5-459d-bd77-8bf4629e7cf4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 24 03:24:25.291920 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:24:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:24:25.355123 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-a9c37146-38c0-4fe8-829d-23d7c8f2f9bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:25.377998 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-a9c37146-38c0-4fe8-829d-23d7c8f2f9bd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078734 Sep 24 03:24:25.378876 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1283 bytes} [Fri Sep 24 03:24:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:24:25.393173 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-8de3bfbc-1bd6-4696-b8ea-8ecd2fb379a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:25.421812 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-8de3bfbc-1bd6-4696-b8ea-8ecd2fb379a6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033915 Sep 24 03:24:25.422495 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1336 bytes} [Fri Sep 24 03:24:25 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:24:27.657997 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-a9c37146-38c0-4fe8-829d-23d7c8f2f9bd admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:27.658871 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-a9c37146-38c0-4fe8-829d-23d7c8f2f9bd admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 24 03:24:27.659295 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:24:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:24:27.721556 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-cd45f73f-cbb7-43b4-b703-dcbbb10d53c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:27.741612 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-cd45f73f-cbb7-43b4-b703-dcbbb10d53c0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075759 Sep 24 03:24:27.742199 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1283 bytes} [Fri Sep 24 03:24:27 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:24:27.755394 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-da2f79a8-2f35-4c3e-991b-c80ab41cd477 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:27.778862 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-da2f79a8-2f35-4c3e-991b-c80ab41cd477 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026776 Sep 24 03:24:27.779253 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1336 bytes} [Fri Sep 24 03:24:27 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:24:30.014650 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-cd45f73f-cbb7-43b4-b703-dcbbb10d53c0 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:30.015659 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-cd45f73f-cbb7-43b4-b703-dcbbb10d53c0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 24 03:24:30.016063 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:24:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:24:30.079710 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-a5af386a-536b-4755-9750-5d8fcdacd55a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "id": "d4", "name": "ds4G"}} {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:30.100492 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-a5af386a-536b-4755-9750-5d8fcdacd55a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077970 Sep 24 03:24:30.109053 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1283 bytes} [Fri Sep 24 03:24:30 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:24:30.114277 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-610894a0-1636-4da5-8c90-ca97af6d9cdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:30.137620 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-610894a0-1636-4da5-8c90-ca97af6d9cdd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027221 Sep 24 03:24:30.145779 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1336 bytes} [Fri Sep 24 03:24:30 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:24:32.364269 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-a5af386a-536b-4755-9750-5d8fcdacd55a admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:32.365281 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-a5af386a-536b-4755-9750-5d8fcdacd55a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 24 03:24:32.365682 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:24:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:24:32.431142 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-7cf6afb0-7262-4db7-8289-a3f363cc3ceb admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:32.455714 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-7cf6afb0-7262-4db7-8289-a3f363cc3ceb admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082860 Sep 24 03:24:32.456261 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1292 bytes} [Fri Sep 24 03:24:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:24:34.811652 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-a5af386a-536b-4755-9750-5d8fcdacd55a admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:34.812668 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-a5af386a-536b-4755-9750-5d8fcdacd55a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 24 03:24:34.813088 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:24:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:24:34.876235 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-f747600f-2bb7-47a4-8bfd-0ef3b9fcb23f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:34.894281 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-f747600f-2bb7-47a4-8bfd-0ef3b9fcb23f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074658 Sep 24 03:24:34.894841 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1283 bytes} [Fri Sep 24 03:24:34 2021] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:24:34.909116 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-816d8a08-b82c-4349-ae6c-482ec230f062 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:34.932168 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-816d8a08-b82c-4349-ae6c-482ec230f062 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026865 Sep 24 03:24:34.932823 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1333 bytes} [Fri Sep 24 03:24:34 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:24:37.393959 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-f747600f-2bb7-47a4-8bfd-0ef3b9fcb23f admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:37.395205 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-f747600f-2bb7-47a4-8bfd-0ef3b9fcb23f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001943 Sep 24 03:24:37.395799 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:24:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:24:37.455981 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-9624330b-0c90-48a7-a9d3-fae14bb45c27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0}} {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:37.475599 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-9624330b-0c90-48a7-a9d3-fae14bb45c27 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073092 Sep 24 03:24:37.476297 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1283 bytes} [Fri Sep 24 03:24:37 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:24:37.490595 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-8b15445e-22ef-4a39-a9fb-846511673d51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:37.517698 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-8b15445e-22ef-4a39-a9fb-846511673d51 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031942 Sep 24 03:24:37.518457 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1333 bytes} [Fri Sep 24 03:24:37 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:24:39.755438 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-9624330b-0c90-48a7-a9d3-fae14bb45c27 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:39.756453 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-9624330b-0c90-48a7-a9d3-fae14bb45c27 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 24 03:24:39.756858 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:24:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:24:39.818653 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-f64617d5-c1c3-4f8b-bdb1-aa774f0687ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "swap": 0}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:39.840076 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-f64617d5-c1c3-4f8b-bdb1-aa774f0687ed admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076393 Sep 24 03:24:39.840635 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1283 bytes} [Fri Sep 24 03:24:39 2021] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:24:39.855839 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-adede2bf-0797-4692-93b3-9251f6567e5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:39.889247 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-adede2bf-0797-4692-93b3-9251f6567e5d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038716 Sep 24 03:24:39.890155 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1333 bytes} [Fri Sep 24 03:24:39 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:24:42.121171 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-f64617d5-c1c3-4f8b-bdb1-aa774f0687ed admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:42.122804 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-f64617d5-c1c3-4f8b-bdb1-aa774f0687ed admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 24 03:24:42.123201 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:24:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:24:42.184117 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-720c92d6-7591-44d9-a9d2-7a10fcf1d34d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80}} {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:42.201672 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-720c92d6-7591-44d9-a9d2-7a10fcf1d34d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071936 Sep 24 03:24:42.202528 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1283 bytes} [Fri Sep 24 03:24:42 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:24:42.215141 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-27df733f-1bf2-4c95-8d65-b8e203a8ed75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:42.239651 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-27df733f-1bf2-4c95-8d65-b8e203a8ed75 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028043 Sep 24 03:24:42.240430 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1333 bytes} [Fri Sep 24 03:24:42 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:24:44.433656 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-720c92d6-7591-44d9-a9d2-7a10fcf1d34d admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:24:44.435261 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-720c92d6-7591-44d9-a9d2-7a10fcf1d34d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002176 Sep 24 03:24:44.435856 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:24:44 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:24:44.508359 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-5f8ccaf8-373d-4f75-9a84-47be27cb2105 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:44.526459 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-5f8ccaf8-373d-4f75-9a84-47be27cb2105 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081442 Sep 24 03:24:44.527100 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1283 bytes} [Fri Sep 24 03:24:44 2021] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:24:44.540259 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-22615ae8-8178-4bea-99dd-dcc00109d009 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:24:44.563705 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-22615ae8-8178-4bea-99dd-dcc00109d009 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027103 Sep 24 03:24:44.564386 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1333 bytes} [Fri Sep 24 03:24:44 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:25:27.532204 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-5f8ccaf8-373d-4f75-9a84-47be27cb2105 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:27.533204 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-5f8ccaf8-373d-4f75-9a84-47be27cb2105 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Sep 24 03:25:27.533599 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:25:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:25:27.592096 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-a21003b7-3d3c-4e62-8650-2db7275b7126 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:27.608370 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-a21003b7-3d3c-4e62-8650-2db7275b7126 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068232 Sep 24 03:25:27.608892 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1292 bytes} [Fri Sep 24 03:25:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:25:29.031924 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-5f8ccaf8-373d-4f75-9a84-47be27cb2105 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:29.032925 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-5f8ccaf8-373d-4f75-9a84-47be27cb2105 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 24 03:25:29.033326 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1075 bytes} [Fri Sep 24 03:25:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:25:29.221935 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-b7790650-a3eb-4c0c-9228-ef23335e79d0 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:29.227267 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.wsgi [None req-b7790650-a3eb-4c0c-9228-ef23335e79d0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 24 03:25:29.227834 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-b7790650-a3eb-4c0c-9228-ef23335e79d0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93325) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:25:29.228629 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-b7790650-a3eb-4c0c-9228-ef23335e79d0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057685 Sep 24 03:25:29.229131 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1191 bytes} [Fri Sep 24 03:25:29 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 03:25:29.238818 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-91346971-7510-420e-8cc9-96be1a5ffb04 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:29.260164 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-91346971-7510-420e-8cc9-96be1a5ffb04 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024822 Sep 24 03:25:29.260700 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1211 bytes} [Fri Sep 24 03:25:29 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:25:29.271480 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-9ef0f9f0-1994-4b89-b9ae-863ef3b43ed5 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:29.292439 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-9ef0f9f0-1994-4b89-b9ae-863ef3b43ed5 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024441 Sep 24 03:25:29.292977 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1211 bytes} [Fri Sep 24 03:25:29 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:25:29.302788 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-b4465781-e2f6-44ee-8771-b28b6f55d9e9 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:29.308011 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.wsgi [None req-b4465781-e2f6-44ee-8771-b28b6f55d9e9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 24 03:25:29.308571 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-b4465781-e2f6-44ee-8771-b28b6f55d9e9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:25:29.309348 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-b4465781-e2f6-44ee-8771-b28b6f55d9e9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010108 Sep 24 03:25:29.310707 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1191 bytes} [Fri Sep 24 03:25:29 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 03:25:30.668543 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-9ef0f9f0-1994-4b89-b9ae-863ef3b43ed5 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:30.669632 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-9ef0f9f0-1994-4b89-b9ae-863ef3b43ed5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 24 03:25:30.670061 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1075 bytes} [Fri Sep 24 03:25:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:25:30.863766 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-00b33493-f424-4135-a863-dfde8b20eef1 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:30.869668 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.wsgi [None req-00b33493-f424-4135-a863-dfde8b20eef1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 24 03:25:30.870252 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-00b33493-f424-4135-a863-dfde8b20eef1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:25:30.871031 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-00b33493-f424-4135-a863-dfde8b20eef1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059230 Sep 24 03:25:30.871527 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1191 bytes} [Fri Sep 24 03:25:30 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 24 03:25:30.882219 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-757d3bd2-8892-4546-a47b-83c0a46975f4 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:30.895198 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-757d3bd2-8892-4546-a47b-83c0a46975f4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016525 Sep 24 03:25:30.895747 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1211 bytes} [Fri Sep 24 03:25:30 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:25:30.905514 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-0e2a9a64-90eb-46f0-b37e-444f7010c7ca admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:30.919538 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-0e2a9a64-90eb-46f0-b37e-444f7010c7ca admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016955 Sep 24 03:25:30.920308 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1211 bytes} [Fri Sep 24 03:25:30 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:25:30.930820 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-de3186cc-85fe-4897-89f1-1a614b6466b5 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:30.936587 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.wsgi [None req-de3186cc-85fe-4897-89f1-1a614b6466b5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 24 03:25:30.937138 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-de3186cc-85fe-4897-89f1-1a614b6466b5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93325) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:25:30.937936 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-de3186cc-85fe-4897-89f1-1a614b6466b5 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010814 Sep 24 03:25:30.938425 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1191 bytes} [Fri Sep 24 03:25:30 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 24 03:25:32.293126 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-0e2a9a64-90eb-46f0-b37e-444f7010c7ca admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:32.294159 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-0e2a9a64-90eb-46f0-b37e-444f7010c7ca admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 24 03:25:32.294559 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1075 bytes} [Fri Sep 24 03:25:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:25:32.487299 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-f6e1b40c-17c5-4d6b-a3dd-f46b7451cfb5 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:32.492729 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.wsgi [None req-f6e1b40c-17c5-4d6b-a3dd-f46b7451cfb5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 24 03:25:32.493281 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-f6e1b40c-17c5-4d6b-a3dd-f46b7451cfb5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93325) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:25:32.494349 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-f6e1b40c-17c5-4d6b-a3dd-f46b7451cfb5 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059380 Sep 24 03:25:32.494848 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1194 bytes} [Fri Sep 24 03:25:32 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 03:25:32.505240 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-f62809ca-30da-4eb6-8edc-7608e4d9fb0b admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:32.518358 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-f62809ca-30da-4eb6-8edc-7608e4d9fb0b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016665 Sep 24 03:25:32.518875 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1211 bytes} [Fri Sep 24 03:25:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:25:32.528323 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:32.541170 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016294 Sep 24 03:25:32.541677 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1211 bytes} [Fri Sep 24 03:25:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:25:32.551734 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-fc065dca-a773-46e7-be2f-5f2d890a7175 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:32.556696 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.wsgi [None req-fc065dca-a773-46e7-be2f-5f2d890a7175 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 24 03:25:32.557259 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-fc065dca-a773-46e7-be2f-5f2d890a7175 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:25:32.558068 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-fc065dca-a773-46e7-be2f-5f2d890a7175 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009766 Sep 24 03:25:32.558558 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1194 bytes} [Fri Sep 24 03:25:32 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 03:25:33.912727 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:33.913754 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 24 03:25:33.914153 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1075 bytes} [Fri Sep 24 03:25:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:25:34.114643 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-cd9b3f4e-497c-42f0-afc6-7b5bcc245f17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:25:34.134752 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-cd9b3f4e-497c-42f0-afc6-7b5bcc245f17 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070736 Sep 24 03:25:34.135222 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1236 bytes} [Fri Sep 24 03:25:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:25:35.533054 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:35.534073 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 24 03:25:35.534469 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1075 bytes} [Fri Sep 24 03:25:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:25:35.724094 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-0c57b293-b09d-4f72-a8d9-2f216c1cb09f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:25:35.741937 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-0c57b293-b09d-4f72-a8d9-2f216c1cb09f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068873 Sep 24 03:25:35.742407 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1236 bytes} [Fri Sep 24 03:25:35 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:25:37.104826 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:37.105908 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 24 03:25:37.106361 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1075 bytes} [Fri Sep 24 03:25:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:25:37.304772 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-f42b8877-a228-4207-abe6-1816b9374b3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:25:37.322374 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-f42b8877-a228-4207-abe6-1816b9374b3f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068617 Sep 24 03:25:37.322906 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1236 bytes} [Fri Sep 24 03:25:37 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:25:38.678953 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:38.679954 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Sep 24 03:25:38.680353 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1075 bytes} [Fri Sep 24 03:25:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:25:38.871261 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-0d16526e-fa16-4d33-9499-41714a14feba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:25:38.890721 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-0d16526e-fa16-4d33-9499-41714a14feba admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070512 Sep 24 03:25:38.891200 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1236 bytes} [Fri Sep 24 03:25:38 2021] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:25:40.240230 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:40.241219 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Sep 24 03:25:40.241613 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1075 bytes} [Fri Sep 24 03:25:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:25:40.441551 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-148c9fef-5379-4a9e-96aa-b946c2e07ac0 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:25:40.462159 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-148c9fef-5379-4a9e-96aa-b946c2e07ac0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074863 Sep 24 03:25:40.462735 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1203 bytes} [Fri Sep 24 03:25:40 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:26:25.930118 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:26:25.931119 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-d919f057-76a6-4201-9cfa-d24bbfdfcd9d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 24 03:26:25.931517 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 931 bytes} [Fri Sep 24 03:26:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:26:25.989531 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-53a229ea-5fe6-4271-9f0c-b6955223df73 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:26:26.008777 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-53a229ea-5fe6-4271-9f0c-b6955223df73 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070088 Sep 24 03:26:26.009303 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1292 bytes} [Fri Sep 24 03:26:25 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:26:26.031913 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-c836e507-9633-44f6-99b6-6598b7894304 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:26:26.039390 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-c836e507-9633-44f6-99b6-6598b7894304 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011027 Sep 24 03:26:26.039910 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1283 bytes} [Fri Sep 24 03:26:26 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:26:26.051933 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-a333dec5-4aca-4fe1-9b8d-b91fb937184d admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:26:26.059460 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-a333dec5-4aca-4fe1-9b8d-b91fb937184d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010984 Sep 24 03:26:26.059967 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1286 bytes} [Fri Sep 24 03:26:26 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:26:26.071548 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-9f94bd4c-16e2-4188-b86c-3d556b254469 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:26:26.079025 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-9f94bd4c-16e2-4188-b86c-3d556b254469 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010864 Sep 24 03:26:26.079528 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1286 bytes} [Fri Sep 24 03:26:26 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:26:26.091524 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-cb735da0-bcbe-4527-bcd8-9b7763627ea2 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:26:26.098793 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-cb735da0-bcbe-4527-bcd8-9b7763627ea2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011187 Sep 24 03:26:26.099302 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1283 bytes} [Fri Sep 24 03:26:26 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:27:52.099579 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-62b79077-8e86-4bd7-946a-20d05ff067f2 tempest-verify_tempest_config-582411124 tempest-verify_tempest_config-582411124-project] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:27:52.101558 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-62b79077-8e86-4bd7-946a-20d05ff067f2 tempest-verify_tempest_config-582411124 tempest-verify_tempest_config-582411124-project] 10.222.0.18 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.115923 Sep 24 03:27:52.102118 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 34/69] 10.222.0.18 () {58 vars in 1134 bytes} [Fri Sep 24 03:27:51 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:29:20.391178 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-cb735da0-bcbe-4527-bcd8-9b7763627ea2 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:29:20.392211 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-cb735da0-bcbe-4527-bcd8-9b7763627ea2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 24 03:29:20.392603 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 36/70] 10.222.0.18 () {56 vars in 1075 bytes} [Fri Sep 24 03:29:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:29:20.647960 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-6ec42267-c375-4628-be42-f6209a63ef53 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:29:20.649123 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:29:20.649123 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: warnings.warn(msg) Sep 24 03:29:20.650676 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-6ec42267-c375-4628-be42-f6209a63ef53 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:29:20.651111 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-6ec42267-c375-4628-be42-f6209a63ef53 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:29:20.651891 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-6ec42267-c375-4628-be42-f6209a63ef53 admin admin] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:29:20.652315 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-6ec42267-c375-4628-be42-f6209a63ef53 admin admin] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:29:20.686855 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-6ec42267-c375-4628-be42-f6209a63ef53 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155799 Sep 24 03:29:20.687425 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 35/71] 10.222.0.18 () {60 vars in 1194 bytes} [Fri Sep 24 03:29:20 2021] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:29:22.062449 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-cb735da0-bcbe-4527-bcd8-9b7763627ea2 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:29:22.063557 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-cb735da0-bcbe-4527-bcd8-9b7763627ea2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 24 03:29:22.063956 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 37/72] 10.222.0.18 () {56 vars in 1075 bytes} [Fri Sep 24 03:29:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:29:22.253734 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-926a3d74-1190-4471-87a8-d4a2ffd48b52 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:29:22.254889 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:29:22.254889 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: warnings.warn(msg) Sep 24 03:29:22.256400 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-926a3d74-1190-4471-87a8-d4a2ffd48b52 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:29:22.256839 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-926a3d74-1190-4471-87a8-d4a2ffd48b52 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:29:22.257620 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-926a3d74-1190-4471-87a8-d4a2ffd48b52 admin admin] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:29:22.258071 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-926a3d74-1190-4471-87a8-d4a2ffd48b52 admin admin] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:29:22.283247 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-926a3d74-1190-4471-87a8-d4a2ffd48b52 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082456 Sep 24 03:29:22.283799 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 36/73] 10.222.0.18 () {60 vars in 1194 bytes} [Fri Sep 24 03:29:22 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:29:34.069986 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-cb735da0-bcbe-4527-bcd8-9b7763627ea2 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:29:34.070989 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-cb735da0-bcbe-4527-bcd8-9b7763627ea2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 24 03:29:34.071384 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 38/74] 10.222.0.18 () {56 vars in 1075 bytes} [Fri Sep 24 03:29:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:29:34.261922 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-6018e6e0-58f2-4dfe-9bb3-bec4d31aae3e admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:29:34.263061 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:29:34.263061 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: warnings.warn(msg) Sep 24 03:29:34.264582 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-6018e6e0-58f2-4dfe-9bb3-bec4d31aae3e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:29:34.265024 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-6018e6e0-58f2-4dfe-9bb3-bec4d31aae3e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:29:34.265855 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-6018e6e0-58f2-4dfe-9bb3-bec4d31aae3e admin admin] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:29:34.266273 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-6018e6e0-58f2-4dfe-9bb3-bec4d31aae3e admin admin] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:29:34.287337 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-6018e6e0-58f2-4dfe-9bb3-bec4d31aae3e admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076627 Sep 24 03:29:34.287873 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 37/75] 10.222.0.18 () {60 vars in 1194 bytes} [Fri Sep 24 03:29:34 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:29:35.669298 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: DEBUG nova.api.openstack.wsgi [None req-cb735da0-bcbe-4527-bcd8-9b7763627ea2 admin admin] Calling method '>' {{(pid=93324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:29:35.670338 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: INFO nova.api.openstack.requestlog [None req-cb735da0-bcbe-4527-bcd8-9b7763627ea2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 24 03:29:35.670749 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: [pid: 93324|app: 0|req: 39/76] 10.222.0.18 () {56 vars in 1075 bytes} [Fri Sep 24 03:29:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:29:35.863800 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG nova.api.openstack.wsgi [None req-5cce2e27-ad11-4829-957a-6ea1c7c8f4e7 admin admin] Calling method '>' {{(pid=93325) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:29:35.864943 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:29:35.864943 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: warnings.warn(msg) Sep 24 03:29:35.866460 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-5cce2e27-ad11-4829-957a-6ea1c7c8f4e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:29:35.866896 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-5cce2e27-ad11-4829-957a-6ea1c7c8f4e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:29:35.867968 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-5cce2e27-ad11-4829-957a-6ea1c7c8f4e7 admin admin] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:29:35.868389 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: DEBUG oslo_concurrency.lockutils [None req-5cce2e27-ad11-4829-957a-6ea1c7c8f4e7 admin admin] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:29:35.890376 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: INFO nova.api.openstack.requestlog [None req-5cce2e27-ad11-4829-957a-6ea1c7c8f4e7 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078569 Sep 24 03:29:35.891729 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: [pid: 93325|app: 0|req: 38/77] 10.222.0.18 () {60 vars in 1194 bytes} [Fri Sep 24 03:29:35 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:30:33.851144 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: Fri Sep 24 03:30:33 2021 - graceful shutdown triggered... Sep 24 03:30:33.851671 dv-cinder-810800-1-iscsi devstack@n-api.service[93325]: Gracefully killing worker 2 (pid: 93325)... Sep 24 03:30:33.852162 dv-cinder-810800-1-iscsi devstack@n-api.service[93324]: Gracefully killing worker 1 (pid: 93324)... Sep 24 03:30:33.853121 dv-cinder-810800-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 24 03:30:34.852344 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: worker 1 buried after 1 seconds Sep 24 03:30:34.852344 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: worker 2 buried after 1 seconds Sep 24 03:30:34.852344 dv-cinder-810800-1-iscsi devstack@n-api.service[93323]: goodbye to uWSGI. Sep 24 03:30:34.853804 dv-cinder-810800-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 24 03:30:34.854345 dv-cinder-810800-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 24 03:30:34.857094 dv-cinder-810800-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 24 03:30:34.866964 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 24 03:30:34.869532 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 24 03:30:34 2021] *** Sep 24 03:30:34.869676 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 03:30:34.869839 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 03:30:34.869978 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: nodename: dv-cinder-810800-1-iscsi Sep 24 03:30:34.869978 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: machine: x86_64 Sep 24 03:30:34.869978 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: clock source: unix Sep 24 03:30:34.869978 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: pcre jit disabled Sep 24 03:30:34.869978 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: detected number of CPU cores: 4 Sep 24 03:30:34.869978 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: current working directory: / Sep 24 03:30:34.869978 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: detected binary path: /usr/bin/uwsgi-core Sep 24 03:30:34.869978 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: your processes number limit is 47680 Sep 24 03:30:34.869978 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: your memory page size is 4096 bytes Sep 24 03:30:34.869978 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: detected max file descriptor number: 2048 Sep 24 03:30:34.870630 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: lock engine: pthread robust mutexes Sep 24 03:30:34.870630 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: thunder lock: enabled Sep 24 03:30:34.870630 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 24 03:30:34.870630 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 24 03:30:34.916177 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: Python main interpreter initialized at 0x560df43b69c0 Sep 24 03:30:34.916177 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: python threads support enabled Sep 24 03:30:34.916177 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: your server socket listen backlog is limited to 100 connections Sep 24 03:30:34.916177 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: your mercy for graceful operations on workers is 90 seconds Sep 24 03:30:34.916539 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 03:30:34.916620 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: *** Operational MODE: preforking *** Sep 24 03:30:34.916920 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: *** uWSGI is running in multiple interpreter mode *** Sep 24 03:30:34.916920 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: spawned uWSGI master process (pid: 109359) Sep 24 03:30:34.917115 dv-cinder-810800-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 24 03:30:34.919156 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: spawned uWSGI worker 1 (pid: 109374, cores: 1) Sep 24 03:30:34.919156 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: spawned uWSGI worker 2 (pid: 109375, cores: 1) Sep 24 03:30:34.919156 dv-cinder-810800-1-iscsi devstack@n-api.service[109359]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 03:30:36.761626 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 03:30:36.761626 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: from cryptography.utils import int_from_bytes Sep 24 03:30:36.762356 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 03:30:36.762356 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: from cryptography.utils import int_from_bytes Sep 24 03:30:36.820392 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 03:30:36.820392 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: from cryptography.utils import int_from_bytes Sep 24 03:30:36.821031 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 03:30:36.821031 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: from cryptography.utils import int_from_bytes Sep 24 03:30:39.464743 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 03:30:39.465322 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 03:30:39.465632 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 03:30:39.469038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 03:30:39.469038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 03:30:39.469038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.469038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.469038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.469038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.469038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.469038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.470268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.470268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.470268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.470268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.470548 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.470874 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810800-1-iscsi {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.471219 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.473298 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.473298 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.473298 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.473298 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.473298 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.473298 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.474050 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.475494 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.475811 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.476148 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.476490 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.476891 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.477248 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.477491 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.478056 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.478561 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.478872 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.479441 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810800-1-iscsi {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.479911 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.480392 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.480712 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.481342 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.481654 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.482001 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.482327 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.482649 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.483137 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.483474 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.483799 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.484122 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.484542 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.487980 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.487980 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.487980 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.487980 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.487980 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.487980 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.488851 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.488851 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.488851 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.489282 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.489436 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.489787 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.490085 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.490360 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.490702 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.491016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.491333 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.491910 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.492227 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.492541 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.492855 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.493170 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.493481 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.493843 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.494169 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.494501 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.494815 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.495146 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.495563 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.495822 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.496137 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.496489 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.496815 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.497130 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.497455 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.497814 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.498131 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.498444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.498755 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.499081 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.499407 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.499716 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.500009 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.500301 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.500585 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.500908 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.501817 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.502158 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.502476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.502783 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.503093 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.503407 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.503726 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.504032 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.504340 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.504651 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.504962 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.505275 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.505584 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.505959 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.506288 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.506596 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.506903 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.507213 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.507521 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.507842 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.508150 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.508457 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.508780 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.509087 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.509394 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.509769 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.510167 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.510351 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.510731 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.511100 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.511282 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.511584 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.511873 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.512253 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.512540 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.513315 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.513315 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.518982 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.518982 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.518982 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.518982 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.518982 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.518982 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.518982 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.518982 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.520135 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.520135 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.520135 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.520135 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.520135 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.520135 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.520135 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.520135 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.521939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.521939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.521939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.521939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.521939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.521939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.521939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.521939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.523377 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.523377 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.523377 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.523377 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.523377 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.523377 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.524207 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.524207 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.524207 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.524647 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.524855 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.525206 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.525524 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.525921 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.526186 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.526510 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.526826 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.527140 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.527455 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.527772 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.528084 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.528397 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.528735 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.529056 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.529372 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.529679 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.530012 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.530320 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.530632 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.530939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.531259 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.531592 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.531972 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.532780 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.533641 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.534439 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.534439 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.534731 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.534883 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.535202 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.535518 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.536212 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.536212 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.536688 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.536857 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.537062 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.537369 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.537801 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.538117 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.538431 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.538746 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.539073 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.539390 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.539702 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.540038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.540373 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.540683 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.541010 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.541342 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.541880 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 03:30:39.542461 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.542624 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 03:30:39.542781 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.542781 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.543207 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 03:30:39.543557 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.543716 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 03:30:39.543872 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.544019 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 03:30:39.544190 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.544335 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.544479 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.544622 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.544773 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.544917 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.545075 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.545229 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.545386 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.545537 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.545682 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.545879 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.546051 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.546226 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.546466 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.546807 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.546958 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.547312 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.547407 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.547491 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.547583 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.547667 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.547750 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.547899 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810800-1-iscsi {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.548496 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.548586 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.548668 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.548751 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.548751 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.548751 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.549152 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.549252 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.549512 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.549652 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.550088 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.550217 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.550317 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.550401 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.550640 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.550757 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.550946 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.551057 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.551281 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.551383 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.551590 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.551690 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.551893 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.551987 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.552211 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.552312 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.552516 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.552632 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.552833 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.552941 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.553136 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.553245 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.553508 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.553622 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810800-1-iscsi {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.553854 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.553967 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.554159 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.554259 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.554469 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.554573 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.554809 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.555045 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.555157 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.555355 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.555465 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.555661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.555762 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.555977 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.556079 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.556298 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.556417 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.556604 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.556754 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.556956 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.557098 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.557254 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.557400 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.557539 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.557682 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.557866 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.558009 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.558164 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.558310 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.558465 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.558605 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.558753 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.558902 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.559054 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.559207 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.559351 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.559496 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.559619 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.559750 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.559851 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.560077 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.560171 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.560390 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.560481 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.560712 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.560813 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.561019 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.561160 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.561297 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.561400 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.561543 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.561652 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.561878 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.562002 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.562191 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.562317 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.562491 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.562664 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.562792 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.562957 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.563092 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.563313 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.563460 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.563932 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.564026 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.564259 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.564360 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.564539 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.564641 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.564840 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.564962 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.565155 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.565288 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.565470 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.565611 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.565858 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.565967 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.566118 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.566258 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.566435 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.566561 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.566828 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.566960 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.567082 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.567231 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.567382 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.567486 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.567718 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.567811 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.568033 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.568132 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.568339 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.568445 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.568652 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.568752 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.568972 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.569086 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.569272 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.569374 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.569574 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.569665 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.569968 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.570072 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.570227 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.570328 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.570544 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.570636 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.570887 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.571045 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.571159 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.575374 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.575508 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.575600 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.575682 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.575765 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.575839 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.575917 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.575988 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.576065 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.576136 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.576215 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.576287 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.576357 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.576433 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.576511 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.576583 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.576682 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.576682 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.576822 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.576892 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.576983 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.577235 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.577333 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.577423 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.577516 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.577607 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.577795 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.577895 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.577976 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.578059 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.578142 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.578238 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.578330 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.578422 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.578513 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.578605 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.578688 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.578769 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.578865 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.578949 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.579555 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.579653 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.579738 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.579825 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.579916 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.580008 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.580092 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.580191 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.580284 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.580375 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.580466 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.580555 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.580555 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.580720 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.580812 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.580897 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.580986 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.581069 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.581200 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.581303 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.581389 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.581479 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.581571 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.581656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.581772 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.582716 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.582824 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.582900 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.582983 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.583065 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.583155 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.583241 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.583335 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.583421 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.583505 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.583586 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.583677 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.583762 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.583840 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.583951 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.584071 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.584301 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.584424 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.584596 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.584779 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.584909 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.585088 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.585228 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.585400 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.585541 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.585703 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.585882 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.586030 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.586135 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.586345 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.586444 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 03:30:39.586649 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.586761 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.586965 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.587090 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.587290 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.587461 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.587565 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.587730 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.587867 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.588061 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.588188 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.588390 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.588490 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.588704 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.588797 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.589011 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.589104 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.589322 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.589423 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.589643 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.589765 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.589985 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.590086 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.590292 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.590398 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.590605 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.590706 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.590920 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.591126 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.591247 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.591443 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.591555 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.591746 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.591854 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.592074 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.592188 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.592376 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.592475 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.592682 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.592796 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.592981 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.593105 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.593290 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.593384 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.593601 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.593706 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.593934 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.594120 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.594271 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.594416 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.594558 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.595295 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.595535 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.595701 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.595845 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.595986 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.596126 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.596265 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.596414 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.596554 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.596695 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.596845 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.596992 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.597141 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.597299 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.597420 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.597580 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.597767 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.597920 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.598060 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.598215 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.598362 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.598501 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.598643 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.598745 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.598845 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.599035 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.599128 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.599335 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.599427 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.599650 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.599756 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.599952 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.600053 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.600252 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.600345 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.600553 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.600654 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.600859 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.600952 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.601165 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.601264 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.601462 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.601588 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.601804 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.601914 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.602106 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.602196 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.602407 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.602506 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.602714 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.602802 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.603016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.603105 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.603314 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.603414 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.603619 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.603709 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.603923 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.604015 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.604241 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.604332 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.604545 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.604634 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.604848 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.604940 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.605149 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.605240 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.605453 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.605550 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.605792 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.605903 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.606083 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.606243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.606387 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.606478 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.606686 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.606785 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.606988 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.607081 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.607288 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.607386 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.607589 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.607693 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.607894 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.607986 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.608201 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.608296 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.608501 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.608661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.608804 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.608906 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.609104 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.609196 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.609435 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.609527 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.609760 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.609866 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.610062 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.610162 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.610397 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.610559 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.610697 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.610796 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.610983 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.611077 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.611284 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.611613 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.611719 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.611953 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.612045 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.612255 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.612358 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.612557 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.612649 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.612854 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.612985 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.613153 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.613254 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.613472 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.613574 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.613793 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.613899 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.614094 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.614233 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.614394 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.614494 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.614693 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.614793 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.615008 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.615107 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.615319 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.615418 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.615637 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.615727 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.615958 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.616053 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.616261 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.616352 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.616822 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.616934 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.617137 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.617228 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.617445 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.617539 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.617769 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.617931 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.618075 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.618212 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.618379 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.618478 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.618686 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.618791 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.618994 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.619130 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.619300 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.619417 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.619604 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.619732 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.619907 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.620035 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.620212 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.620332 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.620518 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.620687 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.620815 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.621011 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.621137 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.621316 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.621640 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.621852 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.621994 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.622114 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.622365 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.622492 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.622614 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.622736 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.622922 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.623045 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.624883 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.624998 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.625102 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.625190 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.625285 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.625370 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.625461 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.625545 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.625637 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.625748 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.625838 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.625982 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.626132 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.626254 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.626343 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.626433 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.626529 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.626529 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.626742 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.626846 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.626932 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.627027 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.627119 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.627210 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.627293 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.627385 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.627478 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.627571 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.627691 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.627824 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.628033 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.628151 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.628303 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.628404 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.628614 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.628716 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.628937 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.629031 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.629241 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.629332 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.629543 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.629634 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.629871 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.630034 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.630192 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.630337 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.630496 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.630645 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.630814 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.630952 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.631229 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.631321 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.631540 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.631632 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.631844 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.631943 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.632144 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.632243 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.632459 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.632606 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.632757 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.632856 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.633062 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.633241 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.633393 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.633622 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.633773 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.633941 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.634108 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.634293 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.634478 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.634632 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.634737 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.634980 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.635103 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.635266 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.635387 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.635578 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.635723 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.635891 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.636093 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.636232 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.636433 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.636537 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.636739 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.636833 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.637062 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.637154 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.637385 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.637478 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.637696 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.637876 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.638134 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.638259 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.638381 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.638465 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.638640 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.638742 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.638945 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.639036 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.639258 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.639350 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.639565 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.639656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.639873 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.639989 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.640195 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.640295 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.640513 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.640604 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.640820 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.640924 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.641128 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.641227 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.641431 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.642104 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.642330 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.642481 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.642640 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.642730 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.642952 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.643053 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.643258 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.643358 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.643577 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.643677 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.643863 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.643972 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.644256 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.644363 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.644477 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.644569 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.644795 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.644900 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.645106 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.645368 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.645461 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.645699 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.645818 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.646034 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.646193 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.646352 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.646453 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.646658 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.646758 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.646961 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.647064 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.647265 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.647365 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.647568 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.647659 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.647897 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.648029 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.648200 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.648317 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.648509 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.648605 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.648813 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.648906 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.649115 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.649213 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.649423 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.649523 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.649742 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.649842 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.650054 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.650146 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.650360 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.650451 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.650665 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.650760 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.650965 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.651066 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.651267 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.651368 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.651577 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.651669 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.651879 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.651988 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.652177 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.652269 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.652477 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.652586 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.652779 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.652879 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.653076 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.653175 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.653374 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.653465 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.653675 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.653810 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.654001 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.654103 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.654314 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.654406 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.654615 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.654708 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.654957 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.655070 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.655259 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.655353 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.655583 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.655682 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.655886 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.655979 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.656188 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.656288 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.656529 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.656628 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.656829 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.656928 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.657180 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.657875 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.658047 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.658200 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.658349 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.658444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.658644 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.658754 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.658954 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.659055 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.659262 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.659355 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.659573 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.659724 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.659873 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.659974 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.660181 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.660274 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.660493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.660599 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.660799 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.660891 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.661100 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.661192 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.661441 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.661534 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.661771 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.661869 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.662086 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.662177 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.662398 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.662493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.662699 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.662791 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.663001 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.663239 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.663366 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.663569 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.663671 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.663884 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.663985 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.664187 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.664293 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.664488 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.664597 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.664800 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.664898 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.665099 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.665193 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.665399 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.665491 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.665698 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.665808 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.666021 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.666122 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.666328 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.666421 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.666627 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.666725 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.666948 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.667049 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.667256 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.667356 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.667555 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.667660 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.667860 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.667960 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.668162 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.668304 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.668460 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.668561 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.668765 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.668882 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.669087 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.669190 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.669400 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.669502 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.669701 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.669838 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.670028 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.670129 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.670336 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.670429 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.670638 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.670737 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.670941 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.671034 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.671248 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.671361 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.671545 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.671638 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.671845 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.671939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.672147 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.672246 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.672449 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.672548 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.672768 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.673438 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.673597 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.673776 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.673911 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.674119 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.674211 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.674458 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.674547 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.674866 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.674959 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.675134 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.675827 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.675827 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.676133 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.676446 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.676623 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.676766 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.677076 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.677381 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.677692 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.678019 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.678334 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.678472 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.678644 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.678770 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.678953 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.679257 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.679550 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.679867 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.680455 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.680803 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.681164 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.681514 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.681892 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.682230 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.682565 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.682908 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.683226 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.683544 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.683865 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.684182 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.684493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.684824 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.685142 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.685448 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.685554 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.686361 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.686457 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.686707 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.686798 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.687079 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.687250 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.687430 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.687610 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.687757 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.687936 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.688086 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.688271 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.688462 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.688768 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.688862 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.689101 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.689218 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.689420 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.689536 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.689764 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.689862 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.690079 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.690187 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.690392 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.690484 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.690715 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.690807 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.691032 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.691136 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.691340 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.691438 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.691649 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.691740 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.691960 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.692059 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.692267 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.692359 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.692595 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.692687 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.692909 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.693012 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.693216 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.693307 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.693526 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.693661 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.693856 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.693951 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.694169 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.694270 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.694475 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.694575 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.694811 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.694911 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.695123 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.695263 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.695428 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.695542 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.695749 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.695881 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.696033 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.696160 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.696406 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.696612 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.696758 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.696907 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.697058 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.697209 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.697349 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.697498 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.697763 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.697909 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.698060 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.698203 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.698354 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.698461 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.698667 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.698760 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.698976 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.699067 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.699281 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.699382 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.699596 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.699713 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.699916 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.700140 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.700253 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.700459 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.700559 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.700785 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.700877 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.701098 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.701200 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.701402 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.701502 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.701739 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.701846 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.702099 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.702239 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.702456 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.702635 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.702760 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.702975 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.703176 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.703316 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.703488 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.703729 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.703827 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.704678 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.704793 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.704994 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.705096 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.705305 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.705410 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.705611 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.705738 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.705974 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.706139 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.706278 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.706415 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.706590 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.706709 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.706902 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.707006 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.707212 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.707315 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.707522 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.707640 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.707831 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.707942 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.708140 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.708244 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.708446 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.708549 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.708756 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.708864 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.709077 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.709179 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.709402 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.709502 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.709744 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.709851 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.710059 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.710162 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.710374 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.710470 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.710686 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.710779 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.710998 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.711103 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.711310 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.711409 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.711619 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.711720 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.711932 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.712048 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.712229 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.712323 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.712548 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.712639 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.712851 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.712999 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.713160 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.713262 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.713469 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.713568 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.713799 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.713921 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.714106 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.714243 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.714411 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.714554 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.714734 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.714925 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.715027 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.715201 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.715348 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.715513 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.715661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.715833 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.715991 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.716146 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.716311 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.716464 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.716621 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.716802 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.716940 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.717130 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.717248 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.717453 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.717547 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.717836 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.717942 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.718160 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.718252 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.718466 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.718566 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.718775 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.718875 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.719100 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.719192 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.719417 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.719517 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.720330 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.720595 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.720700 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.720923 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.721046 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.721252 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.721345 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.721567 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.721661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.721912 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.722006 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.722239 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.722341 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.722545 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.722645 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.722848 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.722941 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.723156 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.723248 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.723460 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.723553 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.723763 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.723856 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.724067 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.724162 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.724374 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.724476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.724675 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.724768 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.724976 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.725114 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.725279 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.725411 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.725883 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.726191 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.726494 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.726741 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.726862 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.726984 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.727098 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.727209 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.727624 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.727780 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.727910 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.728031 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.728151 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.728264 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.728383 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.728578 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.728770 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.728934 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.729048 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.729160 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.729279 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.729437 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.729548 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.729771 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.730006 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.730135 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.730255 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.730412 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.730638 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.730758 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.730870 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.731034 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.731162 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.731358 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.731478 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.731670 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.731772 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.731984 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.732076 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.732297 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.732421 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.732602 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.732739 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.732915 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.733086 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.733225 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.733415 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.733539 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.733726 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 03:30:39.734117 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.734451 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.734770 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.735086 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.735958 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.736273 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.736737 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.737054 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.737368 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.737681 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.738016 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.738345 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.738668 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.738995 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.739331 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.739648 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.739963 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.740279 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.740590 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.740949 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.741264 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.741866 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.742161 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.742478 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.742792 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.743101 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.743411 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.743725 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.744036 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.744348 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.744653 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.744963 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.745275 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.745598 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.745972 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.746292 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.746610 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.746923 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.747235 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.747757 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.748073 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.748405 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.748729 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.749052 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.749365 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.749680 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.750031 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.750339 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.750642 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.751015 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.752063 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.752379 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.752803 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.753125 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.753512 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.753774 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.754108 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.754624 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.754974 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.755307 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.755625 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.755949 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.756276 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.756581 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.756907 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.757216 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.757518 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.757873 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.758188 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.758328 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_db.sqlalchemy.engines [None req-4fafc5e6-0240-43d7-81fb-77ee5771ea88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:30:39.758638 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.758783 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.759090 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.759401 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.759703 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.760011 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.760316 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.760639 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.760942 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.761244 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.761547 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.761881 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.762182 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.762482 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.762785 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.763090 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.763400 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.763700 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.764006 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.764304 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.764612 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.764913 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.765220 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.765520 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.765857 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.766168 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.766469 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.766835 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.767227 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.767551 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.767863 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.768173 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.768524 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.768922 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.769396 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.769744 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.770085 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.770503 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.770845 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.771198 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.771456 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.771762 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.772087 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.772397 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.772762 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.773073 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.773384 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.773690 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.774032 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.774338 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.774706 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.775293 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.775951 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.776580 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.777232 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.777874 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.778491 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.779089 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.779677 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.780034 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.780358 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.780687 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.781029 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.781352 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.781666 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.782142 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.782458 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.782781 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.783106 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.783418 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.783742 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.784066 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.784378 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.784699 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.785012 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.785339 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.785685 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.786043 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.786368 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.786696 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.787019 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.787267 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.787578 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.787908 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.788223 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.788544 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.788851 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.789170 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.789480 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.789823 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.790146 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.790465 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.790774 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.791113 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.791559 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.791802 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.792037 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.792347 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.792657 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.792968 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.793295 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.793622 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.793951 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.794290 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.794607 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.794929 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.795246 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.795557 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.795890 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.796201 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.796515 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.796825 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.797153 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.797452 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.798306 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.798636 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.798963 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.799287 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.799614 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.799960 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.800271 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.800614 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.800941 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 03:30:39.801184 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 03:30:39.823837 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_db.sqlalchemy.engines [None req-b48c66af-7992-4ccd-84fb-afae5ca96c00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:30:39.838504 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.context [None req-4fafc5e6-0240-43d7-81fb-77ee5771ea88 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05fe9a5b-3028-4ccf-ab58-a247bdca46d5(cell1) {{(pid=109374) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 03:30:39.843104 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4fafc5e6-0240-43d7-81fb-77ee5771ea88 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:30:39.844766 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4fafc5e6-0240-43d7-81fb-77ee5771ea88 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:30:39.845777 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4fafc5e6-0240-43d7-81fb-77ee5771ea88 None None] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:30:39.847738 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4fafc5e6-0240-43d7-81fb-77ee5771ea88 None None] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:30:39.858601 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_db.sqlalchemy.engines [None req-4fafc5e6-0240-43d7-81fb-77ee5771ea88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:30:39.859990 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_db.sqlalchemy.engines [None req-4fafc5e6-0240-43d7-81fb-77ee5771ea88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:30:39.902791 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.context [None req-b48c66af-7992-4ccd-84fb-afae5ca96c00 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05fe9a5b-3028-4ccf-ab58-a247bdca46d5(cell1) {{(pid=109375) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 03:30:39.907295 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b48c66af-7992-4ccd-84fb-afae5ca96c00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:30:39.908855 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b48c66af-7992-4ccd-84fb-afae5ca96c00 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:30:39.909959 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b48c66af-7992-4ccd-84fb-afae5ca96c00 None None] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:30:39.911630 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b48c66af-7992-4ccd-84fb-afae5ca96c00 None None] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:30:39.922596 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_db.sqlalchemy.engines [None req-b48c66af-7992-4ccd-84fb-afae5ca96c00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:30:39.923958 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_db.sqlalchemy.engines [None req-b48c66af-7992-4ccd-84fb-afae5ca96c00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:30:40.130572 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_db.sqlalchemy.engines [None req-4fafc5e6-0240-43d7-81fb-77ee5771ea88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:30:40.192663 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_db.sqlalchemy.engines [None req-b48c66af-7992-4ccd-84fb-afae5ca96c00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 03:30:40.465300 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: WARNING keystonemiddleware.auth_token [None req-4fafc5e6-0240-43d7-81fb-77ee5771ea88 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 03:30:40.472386 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: WARNING keystonemiddleware.auth_token [None req-4fafc5e6-0240-43d7-81fb-77ee5771ea88 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 03:30:40.532671 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: WARNING keystonemiddleware.auth_token [None req-b48c66af-7992-4ccd-84fb-afae5ca96c00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 03:30:40.539377 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: WARNING keystonemiddleware.auth_token [None req-b48c66af-7992-4ccd-84fb-afae5ca96c00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 03:30:40.836244 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: WARNING keystonemiddleware.auth_token [None req-4fafc5e6-0240-43d7-81fb-77ee5771ea88 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 03:30:40.841568 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: WARNING keystonemiddleware.auth_token [None req-4fafc5e6-0240-43d7-81fb-77ee5771ea88 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 03:30:40.846788 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560df43b69c0 pid: 109374 (default app) Sep 24 03:30:40.901588 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: WARNING keystonemiddleware.auth_token [None req-b48c66af-7992-4ccd-84fb-afae5ca96c00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 03:30:40.907024 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: WARNING keystonemiddleware.auth_token [None req-b48c66af-7992-4ccd-84fb-afae5ca96c00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 03:30:40.912520 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560df43b69c0 pid: 109375 (default app) Sep 24 03:31:15.740477 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-586dc6b6-b531-4433-b08f-02af2933725e tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] Action: 'create', calling method: .version_select at 0x7f666508c9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-804845454", "metadata": {"Type": "work"}}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:15.745564 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-586dc6b6-b531-4433-b08f-02af2933725e tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:31:15.747112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-586dc6b6-b531-4433-b08f-02af2933725e tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.380145 Sep 24 03:31:15.749158 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1156 bytes} [Fri Sep 24 03:31:14 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1385 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 03:31:15.766273 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f0dbc2ee-2815-4b67-81b6-54392f7d1a5b tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] Action: 'create', calling method: .version_select at 0x7f6665099550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1167415549", "metadata": {"Type": "work"}}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:15.769979 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f0dbc2ee-2815-4b67-81b6-54392f7d1a5b tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:31:15.777180 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f0dbc2ee-2815-4b67-81b6-54392f7d1a5b tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017148 Sep 24 03:31:15.781365 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 2/2] 10.222.0.18 () {60 vars in 1156 bytes} [Fri Sep 24 03:31:15 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 03:31:15.787207 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9b1c279f-9532-47dd-82a8-da1c25f3c3a6 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] Action: 'create', calling method: .version_select at 0x7f666508ca60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1302458074", "metadata": {"Type": "work"}}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:15.797539 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9b1c279f-9532-47dd-82a8-da1c25f3c3a6 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:31:15.799031 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9b1c279f-9532-47dd-82a8-da1c25f3c3a6 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015513 Sep 24 03:31:15.800656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 3/3] 10.222.0.18 () {60 vars in 1156 bytes} [Fri Sep 24 03:31:15 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 03:31:15.813469 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d8adcdcb-dde8-49ad-8453-d985d12b6089 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] Calling method '.version_select at 0x7f66650c5550>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:16.020370 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1448322411", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "networks": [{"uuid": "7a3398f5-9ed0-405e-9ef5-e387b8d91fc7"}]}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:16.122027 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-d8adcdcb-dde8-49ad-8453-d985d12b6089 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] HTTP exception thrown: Volume tempest-invalid-767072270 could not be found. Sep 24 03:31:16.131789 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d8adcdcb-dde8-49ad-8453-d985d12b6089 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] Returning 404 to user: Volume tempest-invalid-767072270 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:31:16.133238 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d8adcdcb-dde8-49ad-8453-d985d12b6089 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-767072270" status: 404 len: 98 microversion: 2.1 time: 0.325470 Sep 24 03:31:16.134833 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 4/4] 10.222.0.18 () {58 vars in 1215 bytes} [Fri Sep 24 03:31:15 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-767072270 => generated 98 bytes in 328 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 03:31:16.144673 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-25221d60-bc8d-4520-8a6b-544dd4992c52 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004853 Sep 24 03:31:16.149118 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 5/5] 10.222.0.18 () {58 vars in 1140 bytes} [Fri Sep 24 03:31:16 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 24 03:31:16.153871 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9db3c7c0-0e9c-4ee9-a458-d13ff4b5fc61 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003713 Sep 24 03:31:16.154367 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 6/6] 10.222.0.18 () {58 vars in 1137 bytes} [Fri Sep 24 03:31:16 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 24 03:31:16.164588 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f7538917-13a6-475f-a22a-835b27c43b13 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] Calling method '.version_select at 0x7f6664f5aaf0>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:16.203475 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-f7538917-13a6-475f-a22a-835b27c43b13 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] HTTP exception thrown: Volume c880b23c-198e-414d-8ec1-cd6fe73ef328 could not be found. Sep 24 03:31:16.204243 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f7538917-13a6-475f-a22a-835b27c43b13 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] Returning 404 to user: Volume c880b23c-198e-414d-8ec1-cd6fe73ef328 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:31:16.205355 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f7538917-13a6-475f-a22a-835b27c43b13 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/c880b23c-198e-414d-8ec1-cd6fe73ef328" status: 404 len: 109 microversion: 2.1 time: 0.044300 Sep 24 03:31:16.210720 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 7/7] 10.222.0.18 () {58 vars in 1248 bytes} [Fri Sep 24 03:31:16 2021] DELETE /compute/v2.1/os-volumes/c880b23c-198e-414d-8ec1-cd6fe73ef328 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 03:31:16.216148 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-870caeea-18c3-49e2-bd0e-dc94e1419d45 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] Calling method '.version_select at 0x7f6664f5a790>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:16.265472 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-870caeea-18c3-49e2-bd0e-dc94e1419d45 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] HTTP exception thrown: Volume ef18d406-68fb-4d42-8ab4-cba3aa60ac73 could not be found. Sep 24 03:31:16.266746 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-870caeea-18c3-49e2-bd0e-dc94e1419d45 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] Returning 404 to user: Volume ef18d406-68fb-4d42-8ab4-cba3aa60ac73 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:31:16.267681 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-870caeea-18c3-49e2-bd0e-dc94e1419d45 tempest-VolumesNegativeTest-1390891333 tempest-VolumesNegativeTest-1390891333-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/ef18d406-68fb-4d42-8ab4-cba3aa60ac73" status: 404 len: 109 microversion: 2.1 time: 0.055516 Sep 24 03:31:16.281769 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 8/8] 10.222.0.18 () {58 vars in 1245 bytes} [Fri Sep 24 03:31:16 2021] GET /compute/v2.1/os-volumes/ef18d406-68fb-4d42-8ab4-cba3aa60ac73 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:31:16.699632 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.network.neutron [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] validate_networks() for [('7a3398f5-9ed0-405e-9ef5-e387b8d91fc7', None, None, None, None, None)] {{(pid=109375) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:31:16.765248 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b77494d9-b28c-4a26-b138-c6fb440ed846 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] Calling method '.version_select at 0x7f6664f72af0>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:16.867351 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b77494d9-b28c-4a26-b138-c6fb440ed846 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/94aac9ed-7f04-4566-b43d-1cef38c2fe12" status: 200 len: 349 microversion: 2.1 time: 0.105899 Sep 24 03:31:16.868024 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 9/9] 10.222.0.18 () {58 vars in 1245 bytes} [Fri Sep 24 03:31:16 2021] GET /compute/v2.1/os-volumes/94aac9ed-7f04-4566-b43d-1cef38c2fe12 => generated 349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:18.467051 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Flavor limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:31:18.467532 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Image limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:31:18.468043 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Flavor pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:31:18.469748 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Image pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:31:18.470320 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:31:18.497154 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:18.497976 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:18.499249 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:18.501030 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:18.584228 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Getting quotas for project df3f7c20fdf04a49852b5b836d442f9c. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:31:18.587502 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7e2f43ac-ba70-429c-a99d-29e6697829af tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] Calling method '.version_select at 0x7f6664f72e50>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:18.602237 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Getting quotas for user 912886a1dda6489c9bd8044116c8a16f and project df3f7c20fdf04a49852b5b836d442f9c. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:31:18.662523 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Going to run 1 instances... {{(pid=109375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:31:18.670665 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:31:18.709301 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7e2f43ac-ba70-429c-a99d-29e6697829af tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bffa5b81-51dd-40bb-beb9-6e78a9b50c32" status: 200 len: 351 microversion: 2.1 time: 0.126109 Sep 24 03:31:18.709966 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 10/10] 10.222.0.18 () {58 vars in 1245 bytes} [Fri Sep 24 03:31:18 2021] GET /compute/v2.1/os-volumes/bffa5b81-51dd-40bb-beb9-6e78a9b50c32 => generated 351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:18.817958 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3a1f7339-5d84-4f11-89e5-348839f6f315 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.875510 Sep 24 03:31:18.821110 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 1/11] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:31:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 3880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:31:18.831223 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7a951f5c-7800-402c-a701-a1865a86a2ef tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:18.831917 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-7a951f5c-7800-402c-a701-a1865a86a2ef tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:19.118195 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7a951f5c-7800-402c-a701-a1865a86a2ef tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:19.138895 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7a951f5c-7800-402c-a701-a1865a86a2ef tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1215 microversion: 2.1 time: 0.311498 Sep 24 03:31:19.151720 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 11/12] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:18 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1215 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:19.736315 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-479797359", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "networks": [{"uuid": "da8a83a1-4718-4b4d-b03f-5ba6c433eea0"}]}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:19.845611 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.network.neutron [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] validate_networks() for [('da8a83a1-4718-4b4d-b03f-5ba6c433eea0', None, None, None, None, None)] {{(pid=109375) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:31:20.159189 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1115cde9-3d2e-4bff-9cef-fb23fad08e21 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:20.159855 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1115cde9-3d2e-4bff-9cef-fb23fad08e21 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:20.494094 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1115cde9-3d2e-4bff-9cef-fb23fad08e21 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:20.501630 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1115cde9-3d2e-4bff-9cef-fb23fad08e21 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1215 microversion: 2.1 time: 0.347018 Sep 24 03:31:20.502230 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 12/13] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:20 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1215 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:31:20.772969 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-87f76054-1dcf-411c-b801-bfe934bc8126 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] Calling method '.version_select at 0x7f6664f2f8b0>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:20.853427 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-87f76054-1dcf-411c-b801-bfe934bc8126 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/9ad16310-7895-4b1b-b0e2-1968aa7e76a1" status: 200 len: 350 microversion: 2.1 time: 0.084803 Sep 24 03:31:20.854770 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 13/14] 10.222.0.18 () {58 vars in 1245 bytes} [Fri Sep 24 03:31:20 2021] GET /compute/v2.1/os-volumes/9ad16310-7895-4b1b-b0e2-1968aa7e76a1 => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:31:20.871163 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0d19e941-01da-468e-8750-8dbb17e2f625 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] Calling method '.version_select at 0x7f6664f3c4c0>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:20.886132 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Flavor limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:31:20.887406 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Image limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:31:20.888239 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Flavor pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:31:20.888684 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Image pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:31:20.889111 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:31:20.901783 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:20.902489 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:20.907170 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:20.918645 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:20.995845 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Getting quotas for project cad76815db3c4a67adf42217edb51d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:31:21.015894 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Getting quotas for user 332a6e416a1347d8927b2d48cc37ac37 and project cad76815db3c4a67adf42217edb51d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:31:21.066428 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Going to run 1 instances... {{(pid=109375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:31:21.070856 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:31:21.137749 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0d19e941-01da-468e-8750-8dbb17e2f625 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.270964 Sep 24 03:31:21.138579 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 14/15] 10.222.0.18 () {58 vars in 1134 bytes} [Fri Sep 24 03:31:20 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:21.153314 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7888afaa-f733-4236-859f-11f182009029 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] Calling method '.version_select at 0x7f6664f2fca0>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:21.222237 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-566f1430-43bc-4d59-a4e7-71995ed257a9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.246114 Sep 24 03:31:21.227430 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 2/16] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:31:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 2252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 03:31:21.286402 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b64bd6e1-d99f-46dc-bd44-bdc49bef2777 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:21.298328 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b64bd6e1-d99f-46dc-bd44-bdc49bef2777 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:21.509280 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7888afaa-f733-4236-859f-11f182009029 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.360579 Sep 24 03:31:21.510182 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 15/17] 10.222.0.18 () {58 vars in 1149 bytes} [Fri Sep 24 03:31:21 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:21.524558 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7537c065-c200-4899-b259-c460e8bd5ebc tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:21.525164 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-7537c065-c200-4899-b259-c460e8bd5ebc tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:21.560951 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7537c065-c200-4899-b259-c460e8bd5ebc tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:21.561412 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7537c065-c200-4899-b259-c460e8bd5ebc tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:21.572759 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7537c065-c200-4899-b259-c460e8bd5ebc tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:21.573264 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7537c065-c200-4899-b259-c460e8bd5ebc tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:22.170876 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b64bd6e1-d99f-46dc-bd44-bdc49bef2777 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:22.197904 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7537c065-c200-4899-b259-c460e8bd5ebc tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:22.202353 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b64bd6e1-d99f-46dc-bd44-bdc49bef2777 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1217 microversion: 2.1 time: 0.952375 Sep 24 03:31:22.204962 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 3/18] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:21 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1217 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:22.212415 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7537c065-c200-4899-b259-c460e8bd5ebc tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1211 microversion: 2.1 time: 0.691484 Sep 24 03:31:22.216515 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-32aa648b-08f7-4da6-b494-3585947d4577 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] Calling method '.version_select at 0x7f66646bb790>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:22.227836 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 16/19] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:21 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1211 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:31:22.518210 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-32aa648b-08f7-4da6-b494-3585947d4577 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.310516 Sep 24 03:31:22.518895 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 4/20] 10.222.0.18 () {58 vars in 1134 bytes} [Fri Sep 24 03:31:22 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:22.530266 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b4d5a177-3721-409f-9847-cf24c33bc3cf tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] Calling method '.version_select at 0x7f6664ebb700>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:22.803817 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b4d5a177-3721-409f-9847-cf24c33bc3cf tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.271266 Sep 24 03:31:22.805046 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 17/21] 10.222.0.18 () {58 vars in 1167 bytes} [Fri Sep 24 03:31:22 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:22.818233 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8d63fc2f-f197-4109-b102-936727b0c904 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] Calling method '.version_select at 0x7f666464adc0>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:23.221502 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a77e8fad-6fa1-4dec-a899-6b005d3a502e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:23.222659 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a77e8fad-6fa1-4dec-a899-6b005d3a502e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:23.318563 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8d63fc2f-f197-4109-b102-936727b0c904 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.505966 Sep 24 03:31:23.319595 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 5/22] 10.222.0.18 () {58 vars in 1170 bytes} [Fri Sep 24 03:31:22 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:23.326712 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e59fdafa-34a3-495c-85cb-0f8d713c170f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:23.327339 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e59fdafa-34a3-495c-85cb-0f8d713c170f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:23.365082 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e59fdafa-34a3-495c-85cb-0f8d713c170f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:23.365082 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e59fdafa-34a3-495c-85cb-0f8d713c170f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:23.368436 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e59fdafa-34a3-495c-85cb-0f8d713c170f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:23.371361 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e59fdafa-34a3-495c-85cb-0f8d713c170f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:23.742981 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a77e8fad-6fa1-4dec-a899-6b005d3a502e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:23.766876 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a77e8fad-6fa1-4dec-a899-6b005d3a502e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1217 microversion: 2.1 time: 0.540863 Sep 24 03:31:23.781932 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 18/23] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:23 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1217 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:23.802894 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-438bb131-bd8e-46ca-92d6-79128fe00920 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] Calling method '.version_select at 0x7f6664ebbdc0>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:24.006058 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-438bb131-bd8e-46ca-92d6-79128fe00920 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.222749 Sep 24 03:31:24.013483 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 19/24] 10.222.0.18 () {58 vars in 1155 bytes} [Fri Sep 24 03:31:23 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:24.013803 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e59fdafa-34a3-495c-85cb-0f8d713c170f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:24.020789 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-fdc2837f-2c38-4c51-8290-34239239c692 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] Calling method '.version_select at 0x7f6664eac9d0>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:24.043321 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e59fdafa-34a3-495c-85cb-0f8d713c170f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1273 microversion: 2.1 time: 0.722372 Sep 24 03:31:24.045626 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 6/25] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:23 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1273 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:24.150546 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-fdc2837f-2c38-4c51-8290-34239239c692 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.135919 Sep 24 03:31:24.158684 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 20/26] 10.222.0.18 () {58 vars in 1188 bytes} [Fri Sep 24 03:31:24 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:24.163856 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-943fd8f8-7d82-4598-93bd-c7bd30d3c091 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] Calling method '.version_select at 0x7f6664550f70>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:24.315017 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-943fd8f8-7d82-4598-93bd-c7bd30d3c091 tempest-VolumesTestJSON-705869160 tempest-VolumesTestJSON-705869160-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.155142 Sep 24 03:31:24.315947 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 7/27] 10.222.0.18 () {58 vars in 1155 bytes} [Fri Sep 24 03:31:24 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:24.790022 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-cbadb6b0-d1b0-46c7-b8e1-b8af3cdc9347 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:24.790736 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-cbadb6b0-d1b0-46c7-b8e1-b8af3cdc9347 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:24.822247 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cbadb6b0-d1b0-46c7-b8e1-b8af3cdc9347 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:24.822682 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cbadb6b0-d1b0-46c7-b8e1-b8af3cdc9347 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:24.830337 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cbadb6b0-d1b0-46c7-b8e1-b8af3cdc9347 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:24.830790 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cbadb6b0-d1b0-46c7-b8e1-b8af3cdc9347 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:24.928074 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-258a745a-b6fc-4360-bc98-4b16c921f695 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'create', calling method: .version_select at 0x7f6664f2fee0>, body: {"keypair": {"name": "tempest-keypair-916254361"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:25.059213 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-258a745a-b6fc-4360-bc98-4b16c921f695 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Getting quotas for project b959a04e215f4456becf31ac01fa6e25. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:31:25.080051 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-258a745a-b6fc-4360-bc98-4b16c921f695 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Getting quotas for user 9abc927649fe4781829fe7d7b8851333 and project b959a04e215f4456becf31ac01fa6e25. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:31:25.198504 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-cbadb6b0-d1b0-46c7-b8e1-b8af3cdc9347 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:25.217608 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-cbadb6b0-d1b0-46c7-b8e1-b8af3cdc9347 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1287 microversion: 2.1 time: 0.426916 Sep 24 03:31:25.219346 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 8/28] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:24 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1287 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:25.248967 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5534df53-dafc-496f-be04-5bc3fb2fe3d8 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:25.251566 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5534df53-dafc-496f-be04-5bc3fb2fe3d8 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:25.273087 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5534df53-dafc-496f-be04-5bc3fb2fe3d8 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:25.274143 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5534df53-dafc-496f-be04-5bc3fb2fe3d8 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:25.274955 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5534df53-dafc-496f-be04-5bc3fb2fe3d8 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:25.275388 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5534df53-dafc-496f-be04-5bc3fb2fe3d8 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:25.523713 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5534df53-dafc-496f-be04-5bc3fb2fe3d8 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:25.537575 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5534df53-dafc-496f-be04-5bc3fb2fe3d8 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1273 microversion: 2.1 time: 0.314354 Sep 24 03:31:25.540389 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 9/29] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:25 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1273 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:26.241659 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-56e8c35a-0c19-4209-90cd-99e4e6be077f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:26.244571 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-56e8c35a-0c19-4209-90cd-99e4e6be077f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:26.260222 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-56e8c35a-0c19-4209-90cd-99e4e6be077f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:26.261438 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-56e8c35a-0c19-4209-90cd-99e4e6be077f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:26.267002 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-56e8c35a-0c19-4209-90cd-99e4e6be077f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:26.267999 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-56e8c35a-0c19-4209-90cd-99e4e6be077f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:26.268179 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-258a745a-b6fc-4360-bc98-4b16c921f695 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Getting quotas for project b959a04e215f4456becf31ac01fa6e25. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:31:26.284455 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-258a745a-b6fc-4360-bc98-4b16c921f695 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Getting quotas for user 9abc927649fe4781829fe7d7b8851333 and project b959a04e215f4456becf31ac01fa6e25. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:31:26.314743 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-258a745a-b6fc-4360-bc98-4b16c921f695 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.931736 Sep 24 03:31:26.326095 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 21/30] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Sep 24 03:31:24 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:26.560118 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ed9a86f0-4b80-4480-b72e-65fc29f31ffe tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:26.561272 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ed9a86f0-4b80-4480-b72e-65fc29f31ffe tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:26.579505 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ed9a86f0-4b80-4480-b72e-65fc29f31ffe tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:26.580290 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ed9a86f0-4b80-4480-b72e-65fc29f31ffe tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:26.585549 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ed9a86f0-4b80-4480-b72e-65fc29f31ffe tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:26.586561 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ed9a86f0-4b80-4480-b72e-65fc29f31ffe tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:26.627605 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-56e8c35a-0c19-4209-90cd-99e4e6be077f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:26.640243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-56e8c35a-0c19-4209-90cd-99e4e6be077f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1275 microversion: 2.1 time: 0.407183 Sep 24 03:31:26.653502 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 10/31] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:26 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1275 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:26.865301 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ed9a86f0-4b80-4480-b72e-65fc29f31ffe tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:26.872874 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ed9a86f0-4b80-4480-b72e-65fc29f31ffe tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1273 microversion: 2.1 time: 0.317430 Sep 24 03:31:26.873460 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 22/32] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:26 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1273 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:27.661524 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-4d4c3afd-a99d-43d0-a7ad-6dd6c45da277 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:27.662325 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-4d4c3afd-a99d-43d0-a7ad-6dd6c45da277 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:27.695851 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4d4c3afd-a99d-43d0-a7ad-6dd6c45da277 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:27.702294 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4d4c3afd-a99d-43d0-a7ad-6dd6c45da277 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:27.704202 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4d4c3afd-a99d-43d0-a7ad-6dd6c45da277 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:27.707985 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4d4c3afd-a99d-43d0-a7ad-6dd6c45da277 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:27.893461 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-467e474d-0e77-42b3-9abf-6b25c099eb0e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:27.896046 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-467e474d-0e77-42b3-9abf-6b25c099eb0e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:27.938575 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-467e474d-0e77-42b3-9abf-6b25c099eb0e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:27.947538 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-467e474d-0e77-42b3-9abf-6b25c099eb0e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:27.948651 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-467e474d-0e77-42b3-9abf-6b25c099eb0e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:27.949436 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-467e474d-0e77-42b3-9abf-6b25c099eb0e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:28.953684 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4d4c3afd-a99d-43d0-a7ad-6dd6c45da277 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:28.963518 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-4d4c3afd-a99d-43d0-a7ad-6dd6c45da277 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1317 microversion: 2.1 time: 1.308532 Sep 24 03:31:28.977305 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 11/33] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:27 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1317 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:29.088130 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-467e474d-0e77-42b3-9abf-6b25c099eb0e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:29.101342 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-467e474d-0e77-42b3-9abf-6b25c099eb0e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1315 microversion: 2.1 time: 1.214693 Sep 24 03:31:29.106732 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 23/34] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:27 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1315 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:31:29.996604 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-883cf938-08b5-40a0-a92f-0affad76ab0f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:29.997460 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-883cf938-08b5-40a0-a92f-0affad76ab0f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:30.030520 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-883cf938-08b5-40a0-a92f-0affad76ab0f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:30.031757 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-883cf938-08b5-40a0-a92f-0affad76ab0f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:30.032970 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-883cf938-08b5-40a0-a92f-0affad76ab0f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:30.033641 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-883cf938-08b5-40a0-a92f-0affad76ab0f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:30.157159 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-365f731a-c566-4b21-8ba9-a9a6edf5a056 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:30.157159 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-365f731a-c566-4b21-8ba9-a9a6edf5a056 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:30.157159 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-365f731a-c566-4b21-8ba9-a9a6edf5a056 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:30.157159 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-365f731a-c566-4b21-8ba9-a9a6edf5a056 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:30.162920 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-365f731a-c566-4b21-8ba9-a9a6edf5a056 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:30.162920 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-365f731a-c566-4b21-8ba9-a9a6edf5a056 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:31.790065 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-883cf938-08b5-40a0-a92f-0affad76ab0f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:31.804441 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-883cf938-08b5-40a0-a92f-0affad76ab0f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1317 microversion: 2.1 time: 1.813135 Sep 24 03:31:31.805457 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 12/35] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:29 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1317 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:32.019885 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-365f731a-c566-4b21-8ba9-a9a6edf5a056 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:32.027733 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-365f731a-c566-4b21-8ba9-a9a6edf5a056 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1315 microversion: 2.1 time: 1.907107 Sep 24 03:31:32.038865 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 24/36] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:30 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1315 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:31:32.826956 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-bd9ef284-f617-45b4-ae2c-2254de9059c6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:32.830197 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-bd9ef284-f617-45b4-ae2c-2254de9059c6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:32.844035 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bd9ef284-f617-45b4-ae2c-2254de9059c6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:32.844963 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bd9ef284-f617-45b4-ae2c-2254de9059c6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:32.846374 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bd9ef284-f617-45b4-ae2c-2254de9059c6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:32.847003 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bd9ef284-f617-45b4-ae2c-2254de9059c6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:33.045517 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-bfc8f9f0-b9e1-4d38-969c-0522666aa283 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:33.047229 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-bfc8f9f0-b9e1-4d38-969c-0522666aa283 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:33.059520 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bfc8f9f0-b9e1-4d38-969c-0522666aa283 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:33.060653 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bfc8f9f0-b9e1-4d38-969c-0522666aa283 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:33.061783 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bfc8f9f0-b9e1-4d38-969c-0522666aa283 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:33.072347 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bfc8f9f0-b9e1-4d38-969c-0522666aa283 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:34.618384 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-bd9ef284-f617-45b4-ae2c-2254de9059c6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:34.626637 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-bd9ef284-f617-45b4-ae2c-2254de9059c6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1317 microversion: 2.1 time: 1.805424 Sep 24 03:31:34.641524 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 13/37] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:32 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1317 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:34.784347 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-bfc8f9f0-b9e1-4d38-969c-0522666aa283 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:34.799060 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-bfc8f9f0-b9e1-4d38-969c-0522666aa283 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1315 microversion: 2.1 time: 1.757008 Sep 24 03:31:34.806650 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 25/38] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:33 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1315 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:35.029475 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-f83e2a1b-70a9-43de-9e57-1ab72847310c req-0424bb7a-b5ab-4faa-8bd8-1508ef671b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c68dca-6afe-4e74-9291-542e2d0529b4", "tag": "8986b042-420b-4efa-b1f8-2c2d72fc703a"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:35.032523 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:31:35.032523 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:31:35.064458 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-f83e2a1b-70a9-43de-9e57-1ab72847310c req-0424bb7a-b5ab-4faa-8bd8-1508ef671b2e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:35.074864 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-f83e2a1b-70a9-43de-9e57-1ab72847310c req-0424bb7a-b5ab-4faa-8bd8-1508ef671b2e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:35.134200 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-f83e2a1b-70a9-43de-9e57-1ab72847310c req-0424bb7a-b5ab-4faa-8bd8-1508ef671b2e service nova] Creating event network-changed:8986b042-420b-4efa-b1f8-2c2d72fc703a for instance 92c68dca-6afe-4e74-9291-542e2d0529b4 on hv-cinder-81080 Sep 24 03:31:35.147055 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-f83e2a1b-70a9-43de-9e57-1ab72847310c req-0424bb7a-b5ab-4faa-8bd8-1508ef671b2e service nova] Acquired lock "compute-rpcapi-router" {{(pid=109375) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 24 03:31:35.149831 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-24979341-dcca-4881-9879-c63fc3e703bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:35.150285 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-24979341-dcca-4881-9879-c63fc3e703bc None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:35.151082 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-24979341-dcca-4881-9879-c63fc3e703bc None None] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:35.151519 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-24979341-dcca-4881-9879-c63fc3e703bc None None] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:35.200723 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.compute.rpcapi [None req-24979341-dcca-4881-9879-c63fc3e703bc None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Sep 24 03:31:35.204950 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-24979341-dcca-4881-9879-c63fc3e703bc None None] Releasing lock "compute-rpcapi-router" {{(pid=109375) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 24 03:31:35.290027 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-24979341-dcca-4881-9879-c63fc3e703bc None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.647036 Sep 24 03:31:35.292481 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 14/39] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:31:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:35.649465 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-088affa2-3b7b-44eb-a9fb-e9bca192d301 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:35.650871 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-088affa2-3b7b-44eb-a9fb-e9bca192d301 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:35.660515 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-088affa2-3b7b-44eb-a9fb-e9bca192d301 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:35.661482 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-088affa2-3b7b-44eb-a9fb-e9bca192d301 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:35.663125 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-088affa2-3b7b-44eb-a9fb-e9bca192d301 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:35.663808 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-088affa2-3b7b-44eb-a9fb-e9bca192d301 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:35.819843 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-4b50db41-9f66-4123-b988-9cf434c5f19f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:35.821657 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-4b50db41-9f66-4123-b988-9cf434c5f19f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:35.858388 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4b50db41-9f66-4123-b988-9cf434c5f19f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:35.860699 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4b50db41-9f66-4123-b988-9cf434c5f19f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:35.861932 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4b50db41-9f66-4123-b988-9cf434c5f19f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:35.870321 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4b50db41-9f66-4123-b988-9cf434c5f19f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:36.711153 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-088affa2-3b7b-44eb-a9fb-e9bca192d301 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:36.721321 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-088affa2-3b7b-44eb-a9fb-e9bca192d301 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1317 microversion: 2.1 time: 1.078203 Sep 24 03:31:36.739318 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 26/40] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:35 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1317 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:36.780817 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4b50db41-9f66-4123-b988-9cf434c5f19f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:36.789635 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-4b50db41-9f66-4123-b988-9cf434c5f19f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1315 microversion: 2.1 time: 0.974338 Sep 24 03:31:36.798914 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 15/41] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:35 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1315 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:36.868414 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-57430803", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cba65e79-4fc5-4461-a342-04d626e59a47"}], "security_groups": [{"name": "tempest-securitygroup--101524179"}], "key_name": "tempest-keypair-916254361", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:37.165150 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.network.neutron [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] validate_networks() for [('cba65e79-4fc5-4461-a342-04d626e59a47', None, None, None, None, None)] {{(pid=109375) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:31:37.298268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-33f9ea7a-6e7a-42af-adf9-2485ebcf301a req-7c6ebd49-26e3-4833-aa9f-90a752eee512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3540174-f6bf-49ec-a73f-a6c97f75cb0c", "tag": "e3ce4347-79c9-4ad9-879b-fbbcc74060cc"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:37.300477 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:31:37.300477 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:31:37.331107 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-33f9ea7a-6e7a-42af-adf9-2485ebcf301a req-7c6ebd49-26e3-4833-aa9f-90a752eee512 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:37.331550 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-33f9ea7a-6e7a-42af-adf9-2485ebcf301a req-7c6ebd49-26e3-4833-aa9f-90a752eee512 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:37.411841 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-33f9ea7a-6e7a-42af-adf9-2485ebcf301a req-7c6ebd49-26e3-4833-aa9f-90a752eee512 service nova] Creating event network-changed:e3ce4347-79c9-4ad9-879b-fbbcc74060cc for instance e3540174-f6bf-49ec-a73f-a6c97f75cb0c on hv-cinder-81080 Sep 24 03:31:37.416335 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-33f9ea7a-6e7a-42af-adf9-2485ebcf301a req-7c6ebd49-26e3-4833-aa9f-90a752eee512 service nova] Acquired lock "compute-rpcapi-router" {{(pid=109374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 24 03:31:37.422141 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-50625838-04dd-4f0a-a3f0-96b74043fea9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:37.426417 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-50625838-04dd-4f0a-a3f0-96b74043fea9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:37.427306 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-50625838-04dd-4f0a-a3f0-96b74043fea9 None None] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:37.427750 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-50625838-04dd-4f0a-a3f0-96b74043fea9 None None] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:37.470718 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.compute.rpcapi [None req-50625838-04dd-4f0a-a3f0-96b74043fea9 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Sep 24 03:31:37.473819 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-50625838-04dd-4f0a-a3f0-96b74043fea9 None None] Releasing lock "compute-rpcapi-router" {{(pid=109374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 24 03:31:37.552409 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-50625838-04dd-4f0a-a3f0-96b74043fea9 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.812035 Sep 24 03:31:37.553329 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 27/42] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:31:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:37.745902 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-47a737e2-1d69-49d2-a720-631b8e777253 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:37.746610 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-47a737e2-1d69-49d2-a720-631b8e777253 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:37.762670 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-47a737e2-1d69-49d2-a720-631b8e777253 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:37.764205 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-47a737e2-1d69-49d2-a720-631b8e777253 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:37.764727 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-47a737e2-1d69-49d2-a720-631b8e777253 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:37.773353 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-47a737e2-1d69-49d2-a720-631b8e777253 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:38.668661 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-47a737e2-1d69-49d2-a720-631b8e777253 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:38.680139 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-47a737e2-1d69-49d2-a720-631b8e777253 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1317 microversion: 2.1 time: 0.939269 Sep 24 03:31:38.691315 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 28/43] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:37 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1317 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:31:38.697072 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3d7cdd5d-edc3-42cc-9233-2ed9b09ab79e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:38.698092 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3d7cdd5d-edc3-42cc-9233-2ed9b09ab79e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:38.706594 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3d7cdd5d-edc3-42cc-9233-2ed9b09ab79e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:38.707649 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3d7cdd5d-edc3-42cc-9233-2ed9b09ab79e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:38.708435 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3d7cdd5d-edc3-42cc-9233-2ed9b09ab79e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:38.709137 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3d7cdd5d-edc3-42cc-9233-2ed9b09ab79e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:39.042434 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Flavor limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:31:39.044357 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Image limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:31:39.046329 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Flavor pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:31:39.048068 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Image pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:31:39.048690 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:31:39.071289 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:39.071890 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:39.072980 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:39.073593 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:39.095880 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Getting quotas for project b959a04e215f4456becf31ac01fa6e25. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:31:39.100657 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Getting quotas for user 9abc927649fe4781829fe7d7b8851333 and project b959a04e215f4456becf31ac01fa6e25. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:31:39.114275 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Going to run 1 instances... {{(pid=109375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:31:39.118780 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:31:39.221784 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c190e0e7-8d1e-4cae-8f85-8d4ffea3bcb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.358479 Sep 24 03:31:39.222905 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 16/44] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:31:36 2021] POST /compute/v2.1/servers => generated 401 bytes in 2360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:31:39.280643 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3d7cdd5d-edc3-42cc-9233-2ed9b09ab79e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:39.291774 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3d7cdd5d-edc3-42cc-9233-2ed9b09ab79e tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1315 microversion: 2.1 time: 0.596476 Sep 24 03:31:39.295041 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 29/45] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:38 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:39.500277 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-178429383", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4489f0f-1647-433c-a28d-da32642eb55e"}]}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:39.596431 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-fc3c6e9a-b846-4061-9e4c-703db478eea8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'create', calling method: .version_select at 0x7f6664589dc0>, body: {"keypair": {"name": "tempest-keypair-754460251"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:39.612939 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.network.neutron [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] validate_networks() for [('e4489f0f-1647-433c-a28d-da32642eb55e', None, None, None, None, None)] {{(pid=109375) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:31:39.639656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-fc3c6e9a-b846-4061-9e4c-703db478eea8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Getting quotas for project 591aadad4ac440c6afd8189aa7e5cee6. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:31:39.652292 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-fc3c6e9a-b846-4061-9e4c-703db478eea8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Getting quotas for user e8050cf3919a4e36865457a4c6568339 and project 591aadad4ac440c6afd8189aa7e5cee6. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:31:40.028214 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-fc3c6e9a-b846-4061-9e4c-703db478eea8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Getting quotas for project 591aadad4ac440c6afd8189aa7e5cee6. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:31:40.034125 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-fc3c6e9a-b846-4061-9e4c-703db478eea8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Getting quotas for user e8050cf3919a4e36865457a4c6568339 and project 591aadad4ac440c6afd8189aa7e5cee6. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:31:40.052750 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-fc3c6e9a-b846-4061-9e4c-703db478eea8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.756340 Sep 24 03:31:40.053663 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 30/46] 10.222.0.18 () {62 vars in 1199 bytes} [Fri Sep 24 03:31:39 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 758 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 24 03:31:40.059649 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-91d3cd8a-630f-40dc-943b-69346c0086c1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:40.060274 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-91d3cd8a-630f-40dc-943b-69346c0086c1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:40.351118 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-91d3cd8a-630f-40dc-943b-69346c0086c1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:40.373110 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-91d3cd8a-630f-40dc-943b-69346c0086c1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1235 microversion: 2.1 time: 0.315654 Sep 24 03:31:40.373810 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 31/47] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:40 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1235 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:40.391422 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e96dbc82-a8ed-4487-85b6-8009a954c3ba tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:40.395005 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e96dbc82-a8ed-4487-85b6-8009a954c3ba tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:40.427752 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e96dbc82-a8ed-4487-85b6-8009a954c3ba tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:40.430474 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e96dbc82-a8ed-4487-85b6-8009a954c3ba tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:40.436220 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e96dbc82-a8ed-4487-85b6-8009a954c3ba tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:40.437809 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e96dbc82-a8ed-4487-85b6-8009a954c3ba tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:40.948680 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e96dbc82-a8ed-4487-85b6-8009a954c3ba tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:40.959510 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e96dbc82-a8ed-4487-85b6-8009a954c3ba tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1317 microversion: 2.1 time: 0.581976 Sep 24 03:31:40.964109 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 32/48] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:40 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:40.977426 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6d4f9d88-6df9-459d-874f-86361d73ca7f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:40.978226 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6d4f9d88-6df9-459d-874f-86361d73ca7f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:40.994482 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6d4f9d88-6df9-459d-874f-86361d73ca7f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:40.995264 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6d4f9d88-6df9-459d-874f-86361d73ca7f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:40.998486 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6d4f9d88-6df9-459d-874f-86361d73ca7f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:41.002792 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6d4f9d88-6df9-459d-874f-86361d73ca7f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:41.274563 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Flavor limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:31:41.275857 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Image limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:31:41.276542 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Flavor pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:31:41.277152 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Image pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:31:41.277823 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:31:41.298051 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:41.298857 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:41.301269 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:41.301952 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:41.346856 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Getting quotas for project 9044a5eb528040b1804ebe0176b04bcb. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:31:41.357556 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Getting quotas for user b607477a72074dcf866931a7f6e1944e and project 9044a5eb528040b1804ebe0176b04bcb. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:31:41.379347 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Going to run 1 instances... {{(pid=109375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:31:41.381920 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:31:41.441406 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-91006d4e-c58d-429f-a79d-80de7af8e1c0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.217374 Sep 24 03:31:41.442770 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 17/49] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:31:39 2021] POST /compute/v2.1/servers => generated 383 bytes in 2219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:31:41.447734 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9a977a34-c4eb-42b6-a66c-b98485febad1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:41.448721 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9a977a34-c4eb-42b6-a66c-b98485febad1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:41.475724 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9a977a34-c4eb-42b6-a66c-b98485febad1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:41.476210 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9a977a34-c4eb-42b6-a66c-b98485febad1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:41.476978 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9a977a34-c4eb-42b6-a66c-b98485febad1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:41.479218 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9a977a34-c4eb-42b6-a66c-b98485febad1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:41.618038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6d4f9d88-6df9-459d-874f-86361d73ca7f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:41.630853 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6d4f9d88-6df9-459d-874f-86361d73ca7f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1315 microversion: 2.1 time: 0.665383 Sep 24 03:31:41.631463 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 33/50] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:40 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:41.654073 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d8ad7b3f-a3a7-437f-98f4-5850cb5f919c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:41.654673 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d8ad7b3f-a3a7-437f-98f4-5850cb5f919c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:41.767768 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9a977a34-c4eb-42b6-a66c-b98485febad1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:41.791801 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9a977a34-c4eb-42b6-a66c-b98485febad1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1293 microversion: 2.1 time: 0.341217 Sep 24 03:31:41.795036 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 18/51] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:41 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1293 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:41.887457 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d8ad7b3f-a3a7-437f-98f4-5850cb5f919c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:41.896176 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d8ad7b3f-a3a7-437f-98f4-5850cb5f919c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1221 microversion: 2.1 time: 0.245611 Sep 24 03:31:41.897865 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 34/52] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:41 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1221 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:41.982243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d40ca529-6179-4479-841a-9e8a212b157c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:41.982934 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d40ca529-6179-4479-841a-9e8a212b157c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:41.997270 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d40ca529-6179-4479-841a-9e8a212b157c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:41.997794 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d40ca529-6179-4479-841a-9e8a212b157c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:41.999935 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d40ca529-6179-4479-841a-9e8a212b157c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:42.002324 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d40ca529-6179-4479-841a-9e8a212b157c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:42.129855 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1405590514", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4489f0f-1647-433c-a28d-da32642eb55e"}]}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:42.272079 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.network.neutron [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] validate_networks() for [('e4489f0f-1647-433c-a28d-da32642eb55e', None, None, None, None, None)] {{(pid=109374) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:31:42.856611 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d40ca529-6179-4479-841a-9e8a212b157c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:42.873911 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d40ca529-6179-4479-841a-9e8a212b157c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1317 microversion: 2.1 time: 0.893151 Sep 24 03:31:42.875412 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 19/53] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:41 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1317 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:42.891652 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-42034f6a-8069-4a9c-bec3-6e6047bb7a78 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:42.892289 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-42034f6a-8069-4a9c-bec3-6e6047bb7a78 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:42.917931 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-42034f6a-8069-4a9c-bec3-6e6047bb7a78 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:42.918860 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-42034f6a-8069-4a9c-bec3-6e6047bb7a78 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:42.922494 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-42034f6a-8069-4a9c-bec3-6e6047bb7a78 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:42.922942 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-42034f6a-8069-4a9c-bec3-6e6047bb7a78 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:43.736131 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-42034f6a-8069-4a9c-bec3-6e6047bb7a78 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:43.750495 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-42034f6a-8069-4a9c-bec3-6e6047bb7a78 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1315 microversion: 2.1 time: 0.864519 Sep 24 03:31:43.761441 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 20/54] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:42 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1315 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:43.761441 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e00dea3b-cd90-4e31-969a-305750634766 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:43.761441 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e00dea3b-cd90-4e31-969a-305750634766 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:43.777371 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e00dea3b-cd90-4e31-969a-305750634766 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:43.778452 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e00dea3b-cd90-4e31-969a-305750634766 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:43.782083 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e00dea3b-cd90-4e31-969a-305750634766 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:43.784008 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e00dea3b-cd90-4e31-969a-305750634766 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:44.750520 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e00dea3b-cd90-4e31-969a-305750634766 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:44.762130 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e00dea3b-cd90-4e31-969a-305750634766 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1360 microversion: 2.1 time: 1.008038 Sep 24 03:31:44.763573 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 21/55] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:43 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1360 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:44.772928 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-41c7be86-1e3d-40f1-9f74-8b129e2dc662 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:44.778072 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-41c7be86-1e3d-40f1-9f74-8b129e2dc662 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:44.791392 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-41c7be86-1e3d-40f1-9f74-8b129e2dc662 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:44.792098 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-41c7be86-1e3d-40f1-9f74-8b129e2dc662 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:44.794730 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-41c7be86-1e3d-40f1-9f74-8b129e2dc662 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:44.795363 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-41c7be86-1e3d-40f1-9f74-8b129e2dc662 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:45.296853 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Flavor limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:31:45.297565 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Image limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:31:45.298655 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Flavor pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:31:45.300996 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Image pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:31:45.300996 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:31:45.313641 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:45.315796 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:45.318307 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:45.319104 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:45.353257 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-41c7be86-1e3d-40f1-9f74-8b129e2dc662 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:45.362888 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Getting quotas for project 9044a5eb528040b1804ebe0176b04bcb. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:31:45.365418 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-41c7be86-1e3d-40f1-9f74-8b129e2dc662 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1317 microversion: 2.1 time: 0.600345 Sep 24 03:31:45.377534 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Getting quotas for user b607477a72074dcf866931a7f6e1944e and project 9044a5eb528040b1804ebe0176b04bcb. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:31:45.378888 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 22/56] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:44 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:45.385727 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c57ecb18-a0c2-49e9-a30b-74735deb4d77 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:45.387105 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c57ecb18-a0c2-49e9-a30b-74735deb4d77 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:45.399220 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c57ecb18-a0c2-49e9-a30b-74735deb4d77 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:45.400210 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c57ecb18-a0c2-49e9-a30b-74735deb4d77 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:45.401804 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c57ecb18-a0c2-49e9-a30b-74735deb4d77 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:45.402761 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c57ecb18-a0c2-49e9-a30b-74735deb4d77 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:45.423753 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Going to run 1 instances... {{(pid=109374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:31:45.435593 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:31:45.569231 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f42cffcb-9087-49f2-b586-f188b1fcdc0c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.443601 Sep 24 03:31:45.570473 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 35/57] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:31:42 2021] POST /compute/v2.1/servers => generated 383 bytes in 3446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:31:45.581156 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a81eac82-4e37-432d-9bd9-41fb2e225fe1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:45.582287 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a81eac82-4e37-432d-9bd9-41fb2e225fe1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:45.674644 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a81eac82-4e37-432d-9bd9-41fb2e225fe1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:45.683702 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a81eac82-4e37-432d-9bd9-41fb2e225fe1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1222 microversion: 2.1 time: 0.107458 Sep 24 03:31:45.684832 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 36/58] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:45 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:45.715960 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1723968449", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a46da72-dbc3-4033-9e4b-9bf85a1d2088"}], "security_groups": [{"name": "tempest-securitygroup--819521343"}], "key_name": "tempest-keypair-754460251", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:46.042811 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c57ecb18-a0c2-49e9-a30b-74735deb4d77 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:46.065882 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c57ecb18-a0c2-49e9-a30b-74735deb4d77 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1315 microversion: 2.1 time: 0.683784 Sep 24 03:31:46.065882 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 23/59] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:45 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:46.095253 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-86133211-fa04-48dc-ad2a-735b81184c74 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:46.096333 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-86133211-fa04-48dc-ad2a-735b81184c74 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:46.101318 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.network.neutron [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] validate_networks() for [('3a46da72-dbc3-4033-9e4b-9bf85a1d2088', None, None, None, None, None)] {{(pid=109374) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:31:46.129692 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-86133211-fa04-48dc-ad2a-735b81184c74 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:46.133441 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-86133211-fa04-48dc-ad2a-735b81184c74 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:46.142075 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-86133211-fa04-48dc-ad2a-735b81184c74 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:46.145480 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-86133211-fa04-48dc-ad2a-735b81184c74 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:47.100808 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-86133211-fa04-48dc-ad2a-735b81184c74 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:47.109572 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-86133211-fa04-48dc-ad2a-735b81184c74 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1360 microversion: 2.1 time: 1.029151 Sep 24 03:31:47.113297 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 24/60] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:46 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1360 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:47.142164 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-0da7cf37-8245-48e5-8b7c-7c63e53f505d req-cefedacd-b01f-46b9-8ba9-8fbf66ad448c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe", "tag": "bb93edc3-4472-46cc-bc7d-748cad3a1f55"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:47.151535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:31:47.151535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:31:47.162931 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-0da7cf37-8245-48e5-8b7c-7c63e53f505d req-cefedacd-b01f-46b9-8ba9-8fbf66ad448c service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:47.163387 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-0da7cf37-8245-48e5-8b7c-7c63e53f505d req-cefedacd-b01f-46b9-8ba9-8fbf66ad448c service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:47.191579 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-0da7cf37-8245-48e5-8b7c-7c63e53f505d req-cefedacd-b01f-46b9-8ba9-8fbf66ad448c service nova] Creating event network-changed:bb93edc3-4472-46cc-bc7d-748cad3a1f55 for instance 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe on hv-cinder-81080 Sep 24 03:31:47.204536 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-0da7cf37-8245-48e5-8b7c-7c63e53f505d req-cefedacd-b01f-46b9-8ba9-8fbf66ad448c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077877 Sep 24 03:31:47.207540 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 25/61] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:31:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:47.213458 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-bb14727e-e055-4c1b-b78c-5772e37069eb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:47.214313 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-bb14727e-e055-4c1b-b78c-5772e37069eb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:47.229978 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bb14727e-e055-4c1b-b78c-5772e37069eb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:47.230698 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bb14727e-e055-4c1b-b78c-5772e37069eb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:47.231640 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bb14727e-e055-4c1b-b78c-5772e37069eb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:47.232219 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bb14727e-e055-4c1b-b78c-5772e37069eb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:47.977762 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-bb14727e-e055-4c1b-b78c-5772e37069eb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:48.000003 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-bb14727e-e055-4c1b-b78c-5772e37069eb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1317 microversion: 2.1 time: 0.790511 Sep 24 03:31:48.000916 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 26/62] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:47 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1317 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:48.007167 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d48f3de8-f67e-4b0b-b144-a1a3a02013fa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:48.009635 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d48f3de8-f67e-4b0b-b144-a1a3a02013fa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:48.016960 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d48f3de8-f67e-4b0b-b144-a1a3a02013fa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:48.018293 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d48f3de8-f67e-4b0b-b144-a1a3a02013fa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:48.019191 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d48f3de8-f67e-4b0b-b144-a1a3a02013fa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:48.019708 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d48f3de8-f67e-4b0b-b144-a1a3a02013fa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:48.117213 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d48f3de8-f67e-4b0b-b144-a1a3a02013fa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:48.127830 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d48f3de8-f67e-4b0b-b144-a1a3a02013fa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1280 microversion: 2.1 time: 0.125596 Sep 24 03:31:48.144542 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 27/63] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:48 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1280 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:48.169320 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Flavor limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:31:48.169972 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Image limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:31:48.169972 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Flavor pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:31:48.170355 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Image pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:31:48.171662 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:31:48.182819 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:48.183263 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:48.184048 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:48.184475 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:48.227193 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Getting quotas for project 591aadad4ac440c6afd8189aa7e5cee6. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:31:48.231358 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Getting quotas for user e8050cf3919a4e36865457a4c6568339 and project 591aadad4ac440c6afd8189aa7e5cee6. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:31:48.243438 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Going to run 1 instances... {{(pid=109374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:31:48.245616 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:31:48.307571 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-af3165c0-0e06-4b86-85d8-ddf5bec41454 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.595335 Sep 24 03:31:48.315414 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 37/64] 10.222.0.18 () {62 vars in 1188 bytes} [Fri Sep 24 03:31:45 2021] POST /compute/v2.1/servers => generated 401 bytes in 2605 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 24 03:31:48.343512 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-406c5ade-8b3d-40da-9799-2b6a0a8f926c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:48.345743 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-406c5ade-8b3d-40da-9799-2b6a0a8f926c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:48.361659 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-406c5ade-8b3d-40da-9799-2b6a0a8f926c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:48.362266 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-406c5ade-8b3d-40da-9799-2b6a0a8f926c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:48.363606 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-406c5ade-8b3d-40da-9799-2b6a0a8f926c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:48.363606 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-406c5ade-8b3d-40da-9799-2b6a0a8f926c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:48.594270 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-b3762e4c-4607-4eef-879a-5366f5e33d98 req-7d39a037-9cf0-4104-89ef-1ed096e5c5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3540174-f6bf-49ec-a73f-a6c97f75cb0c", "name": "network-vif-plugged", "status": "completed", "tag": "e3ce4347-79c9-4ad9-879b-fbbcc74060cc"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:48.596063 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:31:48.596063 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:31:48.609601 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-b3762e4c-4607-4eef-879a-5366f5e33d98 req-7d39a037-9cf0-4104-89ef-1ed096e5c5c1 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:48.610363 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-b3762e4c-4607-4eef-879a-5366f5e33d98 req-7d39a037-9cf0-4104-89ef-1ed096e5c5c1 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:48.632968 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-b3762e4c-4607-4eef-879a-5366f5e33d98 req-7d39a037-9cf0-4104-89ef-1ed096e5c5c1 service nova] Creating event network-vif-plugged:e3ce4347-79c9-4ad9-879b-fbbcc74060cc for instance e3540174-f6bf-49ec-a73f-a6c97f75cb0c on hv-cinder-81080 Sep 24 03:31:48.639018 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-b3762e4c-4607-4eef-879a-5366f5e33d98 req-7d39a037-9cf0-4104-89ef-1ed096e5c5c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.495082 Sep 24 03:31:48.664344 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 28/65] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:31:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:48.678264 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-31e3dbc7-0c65-494f-b67f-9b734180ac82 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:48.679357 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-31e3dbc7-0c65-494f-b67f-9b734180ac82 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:48.719477 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-31e3dbc7-0c65-494f-b67f-9b734180ac82 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:48.719989 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-31e3dbc7-0c65-494f-b67f-9b734180ac82 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:48.721819 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-31e3dbc7-0c65-494f-b67f-9b734180ac82 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:48.725964 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-31e3dbc7-0c65-494f-b67f-9b734180ac82 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:48.763099 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-406c5ade-8b3d-40da-9799-2b6a0a8f926c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:48.778063 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-406c5ade-8b3d-40da-9799-2b6a0a8f926c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1315 microversion: 2.1 time: 0.461342 Sep 24 03:31:48.778660 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 38/66] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:48 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:48.783101 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-74c22e43-e444-4cc2-9637-2602a4e46262 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:48.783903 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-74c22e43-e444-4cc2-9637-2602a4e46262 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:48.943762 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-74c22e43-e444-4cc2-9637-2602a4e46262 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:48.964235 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-74c22e43-e444-4cc2-9637-2602a4e46262 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:48.966113 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-74c22e43-e444-4cc2-9637-2602a4e46262 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:48.967272 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-74c22e43-e444-4cc2-9637-2602a4e46262 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1281 microversion: 2.20 time: 0.187690 Sep 24 03:31:48.990066 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 39/67] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:31:48 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:31:48.995359 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-29ed510d-9e37-454d-ac1b-ab54a6ff319c req-02d7d90e-4864-4720-8a70-d00fce6e5690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "161dd8ef-7ba0-4e37-aaf5-0c0a54dca798", "tag": "515ade53-cef9-43f6-8ae2-c5e8d29c22f8"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:48.997287 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:31:48.997287 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:31:49.010641 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-29ed510d-9e37-454d-ac1b-ab54a6ff319c req-02d7d90e-4864-4720-8a70-d00fce6e5690 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:49.011937 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-29ed510d-9e37-454d-ac1b-ab54a6ff319c req-02d7d90e-4864-4720-8a70-d00fce6e5690 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:49.024078 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-29ed510d-9e37-454d-ac1b-ab54a6ff319c req-02d7d90e-4864-4720-8a70-d00fce6e5690 service nova] Creating event network-changed:515ade53-cef9-43f6-8ae2-c5e8d29c22f8 for instance 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 on hv-cinder-81080 Sep 24 03:31:49.031208 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-29ed510d-9e37-454d-ac1b-ab54a6ff319c req-02d7d90e-4864-4720-8a70-d00fce6e5690 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038328 Sep 24 03:31:49.032641 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 40/68] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:31:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:49.040404 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e5e00633-a3ad-468f-9b89-51fe842dba7c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:49.041426 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e5e00633-a3ad-468f-9b89-51fe842dba7c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:49.049390 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e5e00633-a3ad-468f-9b89-51fe842dba7c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:49.050269 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e5e00633-a3ad-468f-9b89-51fe842dba7c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:49.051539 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e5e00633-a3ad-468f-9b89-51fe842dba7c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:49.052945 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e5e00633-a3ad-468f-9b89-51fe842dba7c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:49.458374 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-31e3dbc7-0c65-494f-b67f-9b734180ac82 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:49.467232 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e5e00633-a3ad-468f-9b89-51fe842dba7c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:49.475848 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e5e00633-a3ad-468f-9b89-51fe842dba7c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1317 microversion: 2.1 time: 0.441463 Sep 24 03:31:49.479223 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-31e3dbc7-0c65-494f-b67f-9b734180ac82 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1360 microversion: 2.1 time: 0.810489 Sep 24 03:31:49.479811 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 29/69] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:48 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1360 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:49.480853 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 41/70] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:49 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:49.486483 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ad164b6d-b163-41d4-ab5f-ce47ce650a77 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:49.487235 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ad164b6d-b163-41d4-ab5f-ce47ce650a77 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:49.505268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ad164b6d-b163-41d4-ab5f-ce47ce650a77 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:49.505817 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ad164b6d-b163-41d4-ab5f-ce47ce650a77 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:49.506670 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ad164b6d-b163-41d4-ab5f-ce47ce650a77 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:49.507173 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ad164b6d-b163-41d4-ab5f-ce47ce650a77 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:49.636994 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ad164b6d-b163-41d4-ab5f-ce47ce650a77 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:49.645692 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ad164b6d-b163-41d4-ab5f-ce47ce650a77 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1322 microversion: 2.1 time: 0.163596 Sep 24 03:31:49.646292 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 42/71] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:49 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:49.794560 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8a766ee7-9a40-4243-8c25-eb9ec3a1c451 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:49.795184 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8a766ee7-9a40-4243-8c25-eb9ec3a1c451 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:49.801273 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8a766ee7-9a40-4243-8c25-eb9ec3a1c451 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:49.801730 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8a766ee7-9a40-4243-8c25-eb9ec3a1c451 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:49.802496 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8a766ee7-9a40-4243-8c25-eb9ec3a1c451 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:49.802922 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8a766ee7-9a40-4243-8c25-eb9ec3a1c451 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:49.927273 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8a766ee7-9a40-4243-8c25-eb9ec3a1c451 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:49.935012 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8a766ee7-9a40-4243-8c25-eb9ec3a1c451 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1315 microversion: 2.1 time: 0.143878 Sep 24 03:31:49.935670 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 30/72] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:49 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:49.986443 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-885deab5-df4a-4ed4-9349-7f168c8361cb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:49.987147 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-885deab5-df4a-4ed4-9349-7f168c8361cb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:49.993398 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-885deab5-df4a-4ed4-9349-7f168c8361cb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:49.994086 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-885deab5-df4a-4ed4-9349-7f168c8361cb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:49.994997 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-885deab5-df4a-4ed4-9349-7f168c8361cb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:49.995490 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-885deab5-df4a-4ed4-9349-7f168c8361cb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:50.080101 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-885deab5-df4a-4ed4-9349-7f168c8361cb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:50.088674 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-885deab5-df4a-4ed4-9349-7f168c8361cb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:50.090219 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-885deab5-df4a-4ed4-9349-7f168c8361cb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:50.091497 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-885deab5-df4a-4ed4-9349-7f168c8361cb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1333 microversion: 2.20 time: 0.109298 Sep 24 03:31:50.092057 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 43/73] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:31:49 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1333 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:31:50.496450 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c86c0e5e-706e-4e53-8b7e-7a9b6cb2798a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:50.497045 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c86c0e5e-706e-4e53-8b7e-7a9b6cb2798a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:50.504744 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8f0f70e2-b79e-4fd5-ab3c-6b8797df66fa tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:50.505386 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8f0f70e2-b79e-4fd5-ab3c-6b8797df66fa tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:50.510893 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c86c0e5e-706e-4e53-8b7e-7a9b6cb2798a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:50.511205 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8f0f70e2-b79e-4fd5-ab3c-6b8797df66fa tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:50.511333 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c86c0e5e-706e-4e53-8b7e-7a9b6cb2798a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:50.511650 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8f0f70e2-b79e-4fd5-ab3c-6b8797df66fa tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:50.512093 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c86c0e5e-706e-4e53-8b7e-7a9b6cb2798a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:50.512459 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8f0f70e2-b79e-4fd5-ab3c-6b8797df66fa tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:50.512547 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c86c0e5e-706e-4e53-8b7e-7a9b6cb2798a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:50.512887 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8f0f70e2-b79e-4fd5-ab3c-6b8797df66fa tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:50.745378 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c86c0e5e-706e-4e53-8b7e-7a9b6cb2798a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:50.752599 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c86c0e5e-706e-4e53-8b7e-7a9b6cb2798a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1360 microversion: 2.1 time: 0.259830 Sep 24 03:31:50.756056 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8f0f70e2-b79e-4fd5-ab3c-6b8797df66fa tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:50.761744 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 31/74] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:50 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1360 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:50.763473 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8f0f70e2-b79e-4fd5-ab3c-6b8797df66fa tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1317 microversion: 2.1 time: 0.262186 Sep 24 03:31:50.764032 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 44/75] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:50 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:50.766336 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9fa8f3d3-241b-424b-8828-2e0ec7d15dca tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:50.766936 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9fa8f3d3-241b-424b-8828-2e0ec7d15dca tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:50.772526 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9fa8f3d3-241b-424b-8828-2e0ec7d15dca tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:50.772967 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9fa8f3d3-241b-424b-8828-2e0ec7d15dca tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:50.773735 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9fa8f3d3-241b-424b-8828-2e0ec7d15dca tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:50.774174 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9fa8f3d3-241b-424b-8828-2e0ec7d15dca tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:50.777179 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-81880eb9-e20f-4b85-9a5a-4f8244bcddfd req-c01ff6e8-b3d0-458a-b070-6ad9281fca7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c68dca-6afe-4e74-9291-542e2d0529b4", "name": "network-vif-plugged", "status": "completed", "tag": "8986b042-420b-4efa-b1f8-2c2d72fc703a"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:50.779000 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:31:50.779000 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:31:50.786709 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-81880eb9-e20f-4b85-9a5a-4f8244bcddfd req-c01ff6e8-b3d0-458a-b070-6ad9281fca7f service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:50.787150 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-81880eb9-e20f-4b85-9a5a-4f8244bcddfd req-c01ff6e8-b3d0-458a-b070-6ad9281fca7f service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:50.799252 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-81880eb9-e20f-4b85-9a5a-4f8244bcddfd req-c01ff6e8-b3d0-458a-b070-6ad9281fca7f service nova] Creating event network-vif-plugged:8986b042-420b-4efa-b1f8-2c2d72fc703a for instance 92c68dca-6afe-4e74-9291-542e2d0529b4 on hv-cinder-81080 Sep 24 03:31:50.804370 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-81880eb9-e20f-4b85-9a5a-4f8244bcddfd req-c01ff6e8-b3d0-458a-b070-6ad9281fca7f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038959 Sep 24 03:31:50.804961 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 45/76] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:31:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:50.915913 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9fa8f3d3-241b-424b-8828-2e0ec7d15dca tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:50.923573 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9fa8f3d3-241b-424b-8828-2e0ec7d15dca tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1322 microversion: 2.1 time: 0.160818 Sep 24 03:31:50.924145 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 32/77] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:50 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:50.953173 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b491bed0-7757-48b4-9f92-faaa6374dfdf tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:50.953895 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b491bed0-7757-48b4-9f92-faaa6374dfdf tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:50.960082 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b491bed0-7757-48b4-9f92-faaa6374dfdf tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:50.960434 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b491bed0-7757-48b4-9f92-faaa6374dfdf tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:50.961187 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b491bed0-7757-48b4-9f92-faaa6374dfdf tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:50.961608 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b491bed0-7757-48b4-9f92-faaa6374dfdf tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:51.096052 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b491bed0-7757-48b4-9f92-faaa6374dfdf tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:51.103323 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b491bed0-7757-48b4-9f92-faaa6374dfdf tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1315 microversion: 2.1 time: 0.154664 Sep 24 03:31:51.110386 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-cf1fe316-1c50-469f-8942-dcda9e325073 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:51.111095 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-cf1fe316-1c50-469f-8942-dcda9e325073 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:51.113080 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 46/78] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:50 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:51.118019 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cf1fe316-1c50-469f-8942-dcda9e325073 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:51.118460 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cf1fe316-1c50-469f-8942-dcda9e325073 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:51.119244 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cf1fe316-1c50-469f-8942-dcda9e325073 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:51.119671 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cf1fe316-1c50-469f-8942-dcda9e325073 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:51.188063 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-cf1fe316-1c50-469f-8942-dcda9e325073 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:51.195688 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-cf1fe316-1c50-469f-8942-dcda9e325073 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:51.197293 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-cf1fe316-1c50-469f-8942-dcda9e325073 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:51.198508 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-cf1fe316-1c50-469f-8942-dcda9e325073 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1333 microversion: 2.20 time: 0.092969 Sep 24 03:31:51.199259 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 33/79] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:31:51 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:31:51.768706 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4f55d075-b1dc-4df8-9fae-698ae02c766b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:51.769295 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4f55d075-b1dc-4df8-9fae-698ae02c766b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:51.775590 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4f55d075-b1dc-4df8-9fae-698ae02c766b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:51.776274 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4f55d075-b1dc-4df8-9fae-698ae02c766b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:51.777029 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4f55d075-b1dc-4df8-9fae-698ae02c766b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:51.777454 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4f55d075-b1dc-4df8-9fae-698ae02c766b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:51.780613 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2f0a160e-5d32-48c8-82c5-ccb030a3acc1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:51.781253 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2f0a160e-5d32-48c8-82c5-ccb030a3acc1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:51.787368 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2f0a160e-5d32-48c8-82c5-ccb030a3acc1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:51.788023 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2f0a160e-5d32-48c8-82c5-ccb030a3acc1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:51.789134 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2f0a160e-5d32-48c8-82c5-ccb030a3acc1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:51.789760 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2f0a160e-5d32-48c8-82c5-ccb030a3acc1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:51.971939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4f55d075-b1dc-4df8-9fae-698ae02c766b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:51.981786 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4f55d075-b1dc-4df8-9fae-698ae02c766b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1360 microversion: 2.1 time: 0.216491 Sep 24 03:31:51.982731 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 47/80] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:51 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1360 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:51.985562 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2f0a160e-5d32-48c8-82c5-ccb030a3acc1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:51.987704 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b2b67d58-321d-459f-a141-1e95fe20b14b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:51.988312 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b2b67d58-321d-459f-a141-1e95fe20b14b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:51.994354 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b2b67d58-321d-459f-a141-1e95fe20b14b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:51.994523 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2f0a160e-5d32-48c8-82c5-ccb030a3acc1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1317 microversion: 2.1 time: 0.217577 Sep 24 03:31:51.994799 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b2b67d58-321d-459f-a141-1e95fe20b14b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:51.995152 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 34/81] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:51 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:31:51.995629 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b2b67d58-321d-459f-a141-1e95fe20b14b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:51.996060 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b2b67d58-321d-459f-a141-1e95fe20b14b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:52.121202 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-80ba7f24-f91d-4d5c-a5a6-598ee0087ce7 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:52.122114 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-80ba7f24-f91d-4d5c-a5a6-598ee0087ce7 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:52.131024 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-80ba7f24-f91d-4d5c-a5a6-598ee0087ce7 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:52.131671 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-80ba7f24-f91d-4d5c-a5a6-598ee0087ce7 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:52.132661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-80ba7f24-f91d-4d5c-a5a6-598ee0087ce7 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:52.133288 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-80ba7f24-f91d-4d5c-a5a6-598ee0087ce7 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:52.140880 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b2b67d58-321d-459f-a141-1e95fe20b14b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:52.148860 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b2b67d58-321d-459f-a141-1e95fe20b14b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1322 microversion: 2.1 time: 0.164966 Sep 24 03:31:52.149541 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 48/82] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:51 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:52.217132 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-559b46bd-2b4d-4ebd-87ac-c1d60bee9f04 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:52.218330 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-559b46bd-2b4d-4ebd-87ac-c1d60bee9f04 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:52.226421 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-559b46bd-2b4d-4ebd-87ac-c1d60bee9f04 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:52.227396 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-559b46bd-2b4d-4ebd-87ac-c1d60bee9f04 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:52.229514 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-559b46bd-2b4d-4ebd-87ac-c1d60bee9f04 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:52.230126 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-559b46bd-2b4d-4ebd-87ac-c1d60bee9f04 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:52.323501 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-559b46bd-2b4d-4ebd-87ac-c1d60bee9f04 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:52.337513 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-559b46bd-2b4d-4ebd-87ac-c1d60bee9f04 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:52.340532 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-559b46bd-2b4d-4ebd-87ac-c1d60bee9f04 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:52.342425 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-559b46bd-2b4d-4ebd-87ac-c1d60bee9f04 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1333 microversion: 2.20 time: 0.129857 Sep 24 03:31:52.343847 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 49/83] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:31:52 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1333 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:31:52.369523 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-80ba7f24-f91d-4d5c-a5a6-598ee0087ce7 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:52.377133 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-80ba7f24-f91d-4d5c-a5a6-598ee0087ce7 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1315 microversion: 2.1 time: 0.260298 Sep 24 03:31:52.377946 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 35/84] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:52 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:31:52.999996 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-37b072e1-28dc-4461-84b4-27846e0d14a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:53.000989 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-37b072e1-28dc-4461-84b4-27846e0d14a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:53.012943 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a8b5b68b-daeb-4ef3-bdfc-eedb28933058 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:53.014034 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a8b5b68b-daeb-4ef3-bdfc-eedb28933058 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:53.021956 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-37b072e1-28dc-4461-84b4-27846e0d14a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:53.025670 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a8b5b68b-daeb-4ef3-bdfc-eedb28933058 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:53.028970 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-37b072e1-28dc-4461-84b4-27846e0d14a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:53.039421 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-37b072e1-28dc-4461-84b4-27846e0d14a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:53.039421 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-37b072e1-28dc-4461-84b4-27846e0d14a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:53.039774 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a8b5b68b-daeb-4ef3-bdfc-eedb28933058 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:53.039774 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a8b5b68b-daeb-4ef3-bdfc-eedb28933058 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:53.039774 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a8b5b68b-daeb-4ef3-bdfc-eedb28933058 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:53.778860 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-37b072e1-28dc-4461-84b4-27846e0d14a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:53.792768 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a8b5b68b-daeb-4ef3-bdfc-eedb28933058 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:53.813518 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a8b5b68b-daeb-4ef3-bdfc-eedb28933058 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1317 microversion: 2.1 time: 0.804664 Sep 24 03:31:53.816138 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 36/85] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:53 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1317 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:53.819387 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-37b072e1-28dc-4461-84b4-27846e0d14a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1360 microversion: 2.1 time: 0.820332 Sep 24 03:31:53.820004 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 50/86] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:52 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1360 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:31:53.829447 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-92293401-6029-4565-8360-e1d34f56df1d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:53.830937 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-75253fe2-786a-4a73-acfe-ceba54dec8c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:53.831780 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-92293401-6029-4565-8360-e1d34f56df1d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:53.834371 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-75253fe2-786a-4a73-acfe-ceba54dec8c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:53.845291 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-75253fe2-786a-4a73-acfe-ceba54dec8c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:53.847599 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92293401-6029-4565-8360-e1d34f56df1d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:53.848426 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92293401-6029-4565-8360-e1d34f56df1d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:53.849417 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92293401-6029-4565-8360-e1d34f56df1d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:53.850078 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92293401-6029-4565-8360-e1d34f56df1d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:53.851354 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-75253fe2-786a-4a73-acfe-ceba54dec8c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:53.855038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-75253fe2-786a-4a73-acfe-ceba54dec8c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:53.855717 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-75253fe2-786a-4a73-acfe-ceba54dec8c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:54.326613 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-75253fe2-786a-4a73-acfe-ceba54dec8c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:54.339202 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-75253fe2-786a-4a73-acfe-ceba54dec8c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:54.341476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-75253fe2-786a-4a73-acfe-ceba54dec8c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:54.346331 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-75253fe2-786a-4a73-acfe-ceba54dec8c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1406 microversion: 2.20 time: 0.521872 Sep 24 03:31:54.346957 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 51/87] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:31:53 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1406 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:31:54.361340 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-bff97777-0fd0-4776-ad51-26182930bc4f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:54.363204 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-bff97777-0fd0-4776-ad51-26182930bc4f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:54.377112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bff97777-0fd0-4776-ad51-26182930bc4f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:54.378302 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bff97777-0fd0-4776-ad51-26182930bc4f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:54.379593 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bff97777-0fd0-4776-ad51-26182930bc4f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:54.380536 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bff97777-0fd0-4776-ad51-26182930bc4f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:54.415751 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-92293401-6029-4565-8360-e1d34f56df1d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:54.426933 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-92293401-6029-4565-8360-e1d34f56df1d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1322 microversion: 2.1 time: 0.607977 Sep 24 03:31:54.427326 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 37/88] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:53 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:54.447217 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-bab990b5-60c1-4fdd-86d9-79cf4bb62f98 req-d549111c-3272-4e44-87e3-6fed97dd0cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe", "name": "network-vif-plugged", "status": "completed", "tag": "bb93edc3-4472-46cc-bc7d-748cad3a1f55"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:54.448865 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:31:54.448865 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:31:54.468228 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-bab990b5-60c1-4fdd-86d9-79cf4bb62f98 req-d549111c-3272-4e44-87e3-6fed97dd0cde service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:54.468799 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-bab990b5-60c1-4fdd-86d9-79cf4bb62f98 req-d549111c-3272-4e44-87e3-6fed97dd0cde service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:54.492463 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-bab990b5-60c1-4fdd-86d9-79cf4bb62f98 req-d549111c-3272-4e44-87e3-6fed97dd0cde service nova] Creating event network-vif-plugged:bb93edc3-4472-46cc-bc7d-748cad3a1f55 for instance 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe on hv-cinder-81080 Sep 24 03:31:54.501938 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-bab990b5-60c1-4fdd-86d9-79cf4bb62f98 req-d549111c-3272-4e44-87e3-6fed97dd0cde service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063998 Sep 24 03:31:54.502819 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 38/89] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:31:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:54.509173 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-7ae94f47-22cd-40d3-9089-1c741cb5c28a req-8ea648e8-04d9-46a7-b4ce-6bb39ab85cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77091753-37d0-4ee1-9824-464b2bd4a70d", "tag": "2d1003e4-1b5a-4b64-a7bf-91ade75c29e4"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:54.513306 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:31:54.513306 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:31:54.525835 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-7ae94f47-22cd-40d3-9089-1c741cb5c28a req-8ea648e8-04d9-46a7-b4ce-6bb39ab85cf5 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:54.526289 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-7ae94f47-22cd-40d3-9089-1c741cb5c28a req-8ea648e8-04d9-46a7-b4ce-6bb39ab85cf5 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:54.552107 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-7ae94f47-22cd-40d3-9089-1c741cb5c28a req-8ea648e8-04d9-46a7-b4ce-6bb39ab85cf5 service nova] Creating event network-changed:2d1003e4-1b5a-4b64-a7bf-91ade75c29e4 for instance 77091753-37d0-4ee1-9824-464b2bd4a70d on hv-cinder-81080 Sep 24 03:31:54.574894 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-7ae94f47-22cd-40d3-9089-1c741cb5c28a req-8ea648e8-04d9-46a7-b4ce-6bb39ab85cf5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070544 Sep 24 03:31:54.575712 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 39/90] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:31:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:54.792426 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-bff97777-0fd0-4776-ad51-26182930bc4f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:54.810340 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-bff97777-0fd0-4776-ad51-26182930bc4f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1502 microversion: 2.1 time: 0.462105 Sep 24 03:31:54.810952 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 52/91] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:54 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1502 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:54.836778 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f19a7e22-186a-4212-83d9-5d98ffb348f0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:54.840538 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-377c3b8e-cddd-4367-8474-f222097dd013 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:54.841257 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-377c3b8e-cddd-4367-8474-f222097dd013 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:54.846574 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f19a7e22-186a-4212-83d9-5d98ffb348f0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:54.851006 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-377c3b8e-cddd-4367-8474-f222097dd013 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:54.851461 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-377c3b8e-cddd-4367-8474-f222097dd013 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:54.852253 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-377c3b8e-cddd-4367-8474-f222097dd013 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:54.852790 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-377c3b8e-cddd-4367-8474-f222097dd013 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:54.871251 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f19a7e22-186a-4212-83d9-5d98ffb348f0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:54.876729 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f19a7e22-186a-4212-83d9-5d98ffb348f0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:54.879142 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f19a7e22-186a-4212-83d9-5d98ffb348f0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:54.881601 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f19a7e22-186a-4212-83d9-5d98ffb348f0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:55.470643 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-f19a7e22-186a-4212-83d9-5d98ffb348f0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:55.478418 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f19a7e22-186a-4212-83d9-5d98ffb348f0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1360 microversion: 2.1 time: 0.645720 Sep 24 03:31:55.479265 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 53/92] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:54 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1360 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:55.493772 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-bfa5b257-cff7-4761-8561-1f5f08a5580e req-bebdb7df-b9fe-4d1c-b0e7-a48a3d5e339e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f043b14-af6f-4d95-a094-87fa6c768493", "tag": "67582d29-a79f-4ee2-8844-18b26e15268b"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:55.495809 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:31:55.495809 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:31:55.502942 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-bfa5b257-cff7-4761-8561-1f5f08a5580e req-bebdb7df-b9fe-4d1c-b0e7-a48a3d5e339e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:55.503585 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-bfa5b257-cff7-4761-8561-1f5f08a5580e req-bebdb7df-b9fe-4d1c-b0e7-a48a3d5e339e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:55.517255 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-bfa5b257-cff7-4761-8561-1f5f08a5580e req-bebdb7df-b9fe-4d1c-b0e7-a48a3d5e339e service nova] Creating event network-changed:67582d29-a79f-4ee2-8844-18b26e15268b for instance 3f043b14-af6f-4d95-a094-87fa6c768493 on hv-cinder-81080 Sep 24 03:31:55.523308 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-bfa5b257-cff7-4761-8561-1f5f08a5580e req-bebdb7df-b9fe-4d1c-b0e7-a48a3d5e339e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033721 Sep 24 03:31:55.524102 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 54/93] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:31:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:55.529923 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5c4fd3b2-ed33-406b-923f-d1a6d86f8845 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:55.530618 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-377c3b8e-cddd-4367-8474-f222097dd013 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:55.531064 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5c4fd3b2-ed33-406b-923f-d1a6d86f8845 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:55.537172 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5c4fd3b2-ed33-406b-923f-d1a6d86f8845 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:55.537627 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5c4fd3b2-ed33-406b-923f-d1a6d86f8845 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:55.538472 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5c4fd3b2-ed33-406b-923f-d1a6d86f8845 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:55.538900 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5c4fd3b2-ed33-406b-923f-d1a6d86f8845 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:55.540311 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-377c3b8e-cddd-4367-8474-f222097dd013 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1507 microversion: 2.1 time: 0.709339 Sep 24 03:31:55.540892 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 40/94] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:54 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1507 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:55.548185 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c7d987db-d0f4-4c0d-af1b-9219b109d323 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:55.549275 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c7d987db-d0f4-4c0d-af1b-9219b109d323 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:55.556613 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c7d987db-d0f4-4c0d-af1b-9219b109d323 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:55.557148 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c7d987db-d0f4-4c0d-af1b-9219b109d323 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:55.559096 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c7d987db-d0f4-4c0d-af1b-9219b109d323 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:55.559495 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c7d987db-d0f4-4c0d-af1b-9219b109d323 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:55.773537 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c7d987db-d0f4-4c0d-af1b-9219b109d323 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:55.786795 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c7d987db-d0f4-4c0d-af1b-9219b109d323 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1322 microversion: 2.1 time: 0.243761 Sep 24 03:31:55.788542 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 41/95] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:55 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:55.829068 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5c4fd3b2-ed33-406b-923f-d1a6d86f8845 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:55.843830 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5c4fd3b2-ed33-406b-923f-d1a6d86f8845 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:55.849392 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5c4fd3b2-ed33-406b-923f-d1a6d86f8845 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:55.853272 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5c4fd3b2-ed33-406b-923f-d1a6d86f8845 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1406 microversion: 2.20 time: 0.327016 Sep 24 03:31:55.855933 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 55/96] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:31:55 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:31:56.495594 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-cdaae33d-47ec-4bc6-9d9e-73b18ce41c7e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:56.496660 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-cdaae33d-47ec-4bc6-9d9e-73b18ce41c7e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:56.508598 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cdaae33d-47ec-4bc6-9d9e-73b18ce41c7e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:56.515799 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cdaae33d-47ec-4bc6-9d9e-73b18ce41c7e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:56.518416 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cdaae33d-47ec-4bc6-9d9e-73b18ce41c7e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:56.520737 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cdaae33d-47ec-4bc6-9d9e-73b18ce41c7e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:56.569008 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-67e9ddec-0e20-4921-bdac-ff0bbc2eef0a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efa6177c-40c7-494c-b2ed-a2d14ab7aebf"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:56.571037 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-67e9ddec-0e20-4921-bdac-ff0bbc2eef0a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:56.584047 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-67e9ddec-0e20-4921-bdac-ff0bbc2eef0a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:56.586782 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-67e9ddec-0e20-4921-bdac-ff0bbc2eef0a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:56.588866 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-67e9ddec-0e20-4921-bdac-ff0bbc2eef0a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:56.589478 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-67e9ddec-0e20-4921-bdac-ff0bbc2eef0a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:56.839050 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-cdaae33d-47ec-4bc6-9d9e-73b18ce41c7e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:56.851359 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-cdaae33d-47ec-4bc6-9d9e-73b18ce41c7e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1360 microversion: 2.1 time: 0.359395 Sep 24 03:31:56.852680 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 42/97] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:56 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1360 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:56.859997 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-0b9ed128-8384-40b8-9f35-db6b50570819 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:56.860955 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-0b9ed128-8384-40b8-9f35-db6b50570819 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:56.873484 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0b9ed128-8384-40b8-9f35-db6b50570819 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:56.874817 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0b9ed128-8384-40b8-9f35-db6b50570819 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:56.875818 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0b9ed128-8384-40b8-9f35-db6b50570819 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:56.876397 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0b9ed128-8384-40b8-9f35-db6b50570819 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:57.119580 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-67e9ddec-0e20-4921-bdac-ff0bbc2eef0a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "POST /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.553861 Sep 24 03:31:57.122900 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 56/98] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:31:56 2021] POST /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:31:57.140453 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4e5db275-111a-41ad-98f8-adfaa095c4d8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:57.141604 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4e5db275-111a-41ad-98f8-adfaa095c4d8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:57.167581 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4e5db275-111a-41ad-98f8-adfaa095c4d8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:57.168100 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4e5db275-111a-41ad-98f8-adfaa095c4d8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:57.168777 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4e5db275-111a-41ad-98f8-adfaa095c4d8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:57.169205 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4e5db275-111a-41ad-98f8-adfaa095c4d8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:57.459904 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-0b9ed128-8384-40b8-9f35-db6b50570819 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:57.473943 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-0b9ed128-8384-40b8-9f35-db6b50570819 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1322 microversion: 2.1 time: 0.618088 Sep 24 03:31:57.477249 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 43/99] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:56 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1322 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:57.483436 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b4eec768-f4ce-4b5a-8bf4-43761efc894e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecf9c83e-d980-4810-815b-7d43489f677e"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:57.490303 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b4eec768-f4ce-4b5a-8bf4-43761efc894e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:57.501789 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4e5db275-111a-41ad-98f8-adfaa095c4d8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:57.507104 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b4eec768-f4ce-4b5a-8bf4-43761efc894e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:57.507717 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b4eec768-f4ce-4b5a-8bf4-43761efc894e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:57.508495 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b4eec768-f4ce-4b5a-8bf4-43761efc894e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:57.510526 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4e5db275-111a-41ad-98f8-adfaa095c4d8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:57.513333 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b4eec768-f4ce-4b5a-8bf4-43761efc894e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:57.523749 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4e5db275-111a-41ad-98f8-adfaa095c4d8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:57.525815 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4e5db275-111a-41ad-98f8-adfaa095c4d8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1406 microversion: 2.20 time: 0.401591 Sep 24 03:31:57.538487 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 57/100] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:31:57 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:31:57.806235 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-8e602e4d-616f-4397-9193-dd7109f20a6f req-781f99dd-5ee9-4a43-8ffc-0d16890f7143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161dd8ef-7ba0-4e37-aaf5-0c0a54dca798", "name": "network-vif-plugged", "status": "completed", "tag": "515ade53-cef9-43f6-8ae2-c5e8d29c22f8"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:57.808623 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:31:57.808623 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:31:57.816526 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-8e602e4d-616f-4397-9193-dd7109f20a6f req-781f99dd-5ee9-4a43-8ffc-0d16890f7143 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:57.817110 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-8e602e4d-616f-4397-9193-dd7109f20a6f req-781f99dd-5ee9-4a43-8ffc-0d16890f7143 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:57.829336 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-8e602e4d-616f-4397-9193-dd7109f20a6f req-781f99dd-5ee9-4a43-8ffc-0d16890f7143 service nova] Creating event network-vif-plugged:515ade53-cef9-43f6-8ae2-c5e8d29c22f8 for instance 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 on hv-cinder-81080 Sep 24 03:31:57.834670 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-8e602e4d-616f-4397-9193-dd7109f20a6f req-781f99dd-5ee9-4a43-8ffc-0d16890f7143 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032532 Sep 24 03:31:57.835384 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 58/101] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:31:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:31:57.877925 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7447ccbb-59de-456e-b1f6-c67b0fa84196 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:57.878913 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-7447ccbb-59de-456e-b1f6-c67b0fa84196 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:57.886175 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7447ccbb-59de-456e-b1f6-c67b0fa84196 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:57.886626 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7447ccbb-59de-456e-b1f6-c67b0fa84196 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:57.887407 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7447ccbb-59de-456e-b1f6-c67b0fa84196 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:57.887837 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7447ccbb-59de-456e-b1f6-c67b0fa84196 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:58.065773 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7447ccbb-59de-456e-b1f6-c67b0fa84196 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:58.085136 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7447ccbb-59de-456e-b1f6-c67b0fa84196 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1546 microversion: 2.1 time: 0.217420 Sep 24 03:31:58.086974 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 59/102] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:57 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1546 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:58.103779 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0855e57d-8dad-4ca8-90f4-97c6bea79171 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:58.104543 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0855e57d-8dad-4ca8-90f4-97c6bea79171 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:58.114354 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0855e57d-8dad-4ca8-90f4-97c6bea79171 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:58.116859 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0855e57d-8dad-4ca8-90f4-97c6bea79171 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:58.118011 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0855e57d-8dad-4ca8-90f4-97c6bea79171 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:58.118877 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0855e57d-8dad-4ca8-90f4-97c6bea79171 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:58.273173 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0855e57d-8dad-4ca8-90f4-97c6bea79171 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174469 Sep 24 03:31:58.274046 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 60/103] 10.222.0.18 () {58 vars in 1275 bytes} [Fri Sep 24 03:31:58 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:58.493642 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-40d32831-30af-4eea-85be-63c3776a6994 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:58.494311 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-40d32831-30af-4eea-85be-63c3776a6994 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:58.502791 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-40d32831-30af-4eea-85be-63c3776a6994 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:58.503300 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-40d32831-30af-4eea-85be-63c3776a6994 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:58.504093 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-40d32831-30af-4eea-85be-63c3776a6994 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:58.504731 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-40d32831-30af-4eea-85be-63c3776a6994 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:58.565147 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b4eec768-f4ce-4b5a-8bf4-43761efc894e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "POST /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.086297 Sep 24 03:31:58.566246 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 44/104] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:31:57 2021] POST /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4/os-volume_attachments => generated 194 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:31:58.573685 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6f1bb69f-57cb-4a4f-9659-513d13e2fb7b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:31:58.574684 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6f1bb69f-57cb-4a4f-9659-513d13e2fb7b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:58.590366 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6f1bb69f-57cb-4a4f-9659-513d13e2fb7b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:58.591121 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6f1bb69f-57cb-4a4f-9659-513d13e2fb7b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:58.592128 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6f1bb69f-57cb-4a4f-9659-513d13e2fb7b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:58.593488 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6f1bb69f-57cb-4a4f-9659-513d13e2fb7b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:59.007869 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6f1bb69f-57cb-4a4f-9659-513d13e2fb7b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:59.017640 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6f1bb69f-57cb-4a4f-9659-513d13e2fb7b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:59.019368 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6f1bb69f-57cb-4a4f-9659-513d13e2fb7b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:59.020486 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-40d32831-30af-4eea-85be-63c3776a6994 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:31:59.021170 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6f1bb69f-57cb-4a4f-9659-513d13e2fb7b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1406 microversion: 2.20 time: 0.453043 Sep 24 03:31:59.033191 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 45/105] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:31:58 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1406 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:31:59.034082 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-40d32831-30af-4eea-85be-63c3776a6994 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1322 microversion: 2.1 time: 0.544253 Sep 24 03:31:59.034862 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 61/106] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:31:58 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:31:59.922997 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b6a0c487-6544-4a42-9913-f70f64af5079 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:59.925538 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-e29bd35f-901b-4cf8-8231-e273038c201d req-adba8bc1-3365-4510-8d6a-fe6d16660c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe", "tag": "bb93edc3-4472-46cc-bc7d-748cad3a1f55"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:31:59.925911 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b6a0c487-6544-4a42-9913-f70f64af5079 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:31:59.927679 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:31:59.927679 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:31:59.945167 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-e29bd35f-901b-4cf8-8231-e273038c201d req-adba8bc1-3365-4510-8d6a-fe6d16660c07 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:59.945703 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-e29bd35f-901b-4cf8-8231-e273038c201d req-adba8bc1-3365-4510-8d6a-fe6d16660c07 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:59.951772 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b6a0c487-6544-4a42-9913-f70f64af5079 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:59.952899 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b6a0c487-6544-4a42-9913-f70f64af5079 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:59.955342 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b6a0c487-6544-4a42-9913-f70f64af5079 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:31:59.956108 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b6a0c487-6544-4a42-9913-f70f64af5079 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:31:59.972212 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-e29bd35f-901b-4cf8-8231-e273038c201d req-adba8bc1-3365-4510-8d6a-fe6d16660c07 service nova] Creating event network-changed:bb93edc3-4472-46cc-bc7d-748cad3a1f55 for instance 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe on hv-cinder-81080 Sep 24 03:31:59.978368 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-e29bd35f-901b-4cf8-8231-e273038c201d req-adba8bc1-3365-4510-8d6a-fe6d16660c07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057261 Sep 24 03:31:59.979804 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 62/107] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:31:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:32:00.042906 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3fb568ab-3c37-4e38-a899-bfbd393e1d44 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:00.046124 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3fb568ab-3c37-4e38-a899-bfbd393e1d44 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:00.048290 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b6a0c487-6544-4a42-9913-f70f64af5079 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 14 microversion: 2.1 time: 0.130181 Sep 24 03:32:00.049308 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 46/108] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:31:59 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:32:00.055076 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b9f5184d-779e-4270-bfbb-9fe07c9e4170 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:00.057675 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b9f5184d-779e-4270-bfbb-9fe07c9e4170 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:00.059416 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3fb568ab-3c37-4e38-a899-bfbd393e1d44 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:00.059870 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3fb568ab-3c37-4e38-a899-bfbd393e1d44 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:00.063386 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3fb568ab-3c37-4e38-a899-bfbd393e1d44 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:00.064172 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3fb568ab-3c37-4e38-a899-bfbd393e1d44 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:00.074959 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b9f5184d-779e-4270-bfbb-9fe07c9e4170 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:00.075434 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b9f5184d-779e-4270-bfbb-9fe07c9e4170 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:00.076240 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b9f5184d-779e-4270-bfbb-9fe07c9e4170 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:00.078947 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b9f5184d-779e-4270-bfbb-9fe07c9e4170 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:00.513285 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b9f5184d-779e-4270-bfbb-9fe07c9e4170 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:00.527666 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b9f5184d-779e-4270-bfbb-9fe07c9e4170 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1322 microversion: 2.1 time: 0.476787 Sep 24 03:32:00.528683 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 47/109] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:00 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:00.532156 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3fb568ab-3c37-4e38-a899-bfbd393e1d44 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:00.544793 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3fb568ab-3c37-4e38-a899-bfbd393e1d44 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:00.549627 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3fb568ab-3c37-4e38-a899-bfbd393e1d44 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:00.550811 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3fb568ab-3c37-4e38-a899-bfbd393e1d44 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1406 microversion: 2.20 time: 0.514611 Sep 24 03:32:00.554084 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 63/110] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:32:00 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1406 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:32:01.060399 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f9466b35-4c82-481d-9fbb-a9535d3bd019 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:01.061993 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f9466b35-4c82-481d-9fbb-a9535d3bd019 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:01.079581 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f9466b35-4c82-481d-9fbb-a9535d3bd019 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:01.083680 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f9466b35-4c82-481d-9fbb-a9535d3bd019 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:01.088860 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f9466b35-4c82-481d-9fbb-a9535d3bd019 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:01.089397 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f9466b35-4c82-481d-9fbb-a9535d3bd019 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:01.165837 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f9466b35-4c82-481d-9fbb-a9535d3bd019 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 14 microversion: 2.1 time: 0.109579 Sep 24 03:32:01.169349 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 48/111] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:01 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:32:01.547206 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9a4ea000-7456-44bf-a30c-2e693ee6b587 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:01.547809 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9a4ea000-7456-44bf-a30c-2e693ee6b587 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:01.554112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9a4ea000-7456-44bf-a30c-2e693ee6b587 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:01.554689 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9a4ea000-7456-44bf-a30c-2e693ee6b587 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:01.555563 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9a4ea000-7456-44bf-a30c-2e693ee6b587 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:01.556204 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9a4ea000-7456-44bf-a30c-2e693ee6b587 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:01.572099 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8413a31b-0509-4d57-881e-8e107c49b677 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:01.573092 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8413a31b-0509-4d57-881e-8e107c49b677 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:01.580226 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8413a31b-0509-4d57-881e-8e107c49b677 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:01.580978 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8413a31b-0509-4d57-881e-8e107c49b677 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:01.581994 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8413a31b-0509-4d57-881e-8e107c49b677 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:01.582630 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8413a31b-0509-4d57-881e-8e107c49b677 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:01.781734 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-9a4ea000-7456-44bf-a30c-2e693ee6b587 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:01.789277 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8413a31b-0509-4d57-881e-8e107c49b677 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:01.791626 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9a4ea000-7456-44bf-a30c-2e693ee6b587 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1322 microversion: 2.1 time: 0.248016 Sep 24 03:32:01.792375 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 64/112] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:01 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:01.799524 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8413a31b-0509-4d57-881e-8e107c49b677 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:01.801645 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8413a31b-0509-4d57-881e-8e107c49b677 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:01.803068 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8413a31b-0509-4d57-881e-8e107c49b677 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1406 microversion: 2.20 time: 0.235085 Sep 24 03:32:01.803729 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 49/113] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:32:01 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:32:02.177662 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3f214947-bb01-4863-bd77-754f02d523a1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:02.178629 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3f214947-bb01-4863-bd77-754f02d523a1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:02.184628 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3f214947-bb01-4863-bd77-754f02d523a1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:02.185272 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3f214947-bb01-4863-bd77-754f02d523a1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:02.186794 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3f214947-bb01-4863-bd77-754f02d523a1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:02.187376 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3f214947-bb01-4863-bd77-754f02d523a1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:02.255280 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3f214947-bb01-4863-bd77-754f02d523a1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 14 microversion: 2.1 time: 0.081666 Sep 24 03:32:02.255907 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 65/114] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:02 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:32:02.808993 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-81e7ae67-077c-45c4-82a4-f77bff697536 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:02.809624 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-81e7ae67-077c-45c4-82a4-f77bff697536 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:02.816480 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-81e7ae67-077c-45c4-82a4-f77bff697536 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:02.816914 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-81e7ae67-077c-45c4-82a4-f77bff697536 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:02.817677 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-81e7ae67-077c-45c4-82a4-f77bff697536 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:02.818125 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-81e7ae67-077c-45c4-82a4-f77bff697536 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:02.821902 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-530ee63b-8fc7-4235-8e7d-6d0e7697408f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:02.822795 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-530ee63b-8fc7-4235-8e7d-6d0e7697408f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:02.829194 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-530ee63b-8fc7-4235-8e7d-6d0e7697408f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:02.829647 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-530ee63b-8fc7-4235-8e7d-6d0e7697408f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:02.830468 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-530ee63b-8fc7-4235-8e7d-6d0e7697408f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:02.830900 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-530ee63b-8fc7-4235-8e7d-6d0e7697408f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:02.998607 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-81e7ae67-077c-45c4-82a4-f77bff697536 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:03.006394 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-81e7ae67-077c-45c4-82a4-f77bff697536 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1322 microversion: 2.1 time: 0.200856 Sep 24 03:32:03.006973 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 50/115] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:02 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:03.011293 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-530ee63b-8fc7-4235-8e7d-6d0e7697408f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:03.019261 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-530ee63b-8fc7-4235-8e7d-6d0e7697408f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:03.021032 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-530ee63b-8fc7-4235-8e7d-6d0e7697408f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:03.022155 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-530ee63b-8fc7-4235-8e7d-6d0e7697408f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1406 microversion: 2.20 time: 0.204390 Sep 24 03:32:03.022697 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 66/116] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:32:02 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:32:03.266160 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e8ebb208-d84e-4739-abd2-f404a3d1c36c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:03.267078 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e8ebb208-d84e-4739-abd2-f404a3d1c36c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:03.273038 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e8ebb208-d84e-4739-abd2-f404a3d1c36c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:03.273489 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e8ebb208-d84e-4739-abd2-f404a3d1c36c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:03.274304 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e8ebb208-d84e-4739-abd2-f404a3d1c36c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:03.274731 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e8ebb208-d84e-4739-abd2-f404a3d1c36c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:03.345137 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e8ebb208-d84e-4739-abd2-f404a3d1c36c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 14 microversion: 2.1 time: 0.082881 Sep 24 03:32:03.346173 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 51/117] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:03 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 03:32:03.841582 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-c98d8eaf-bdeb-43b2-8d1d-b143a0a15a15 req-f92fa535-104a-4f3f-bf9e-594429b1a2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f043b14-af6f-4d95-a094-87fa6c768493", "name": "network-vif-plugged", "status": "completed", "tag": "67582d29-a79f-4ee2-8844-18b26e15268b"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:03.845563 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:32:03.845563 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:32:03.853778 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-c98d8eaf-bdeb-43b2-8d1d-b143a0a15a15 req-f92fa535-104a-4f3f-bf9e-594429b1a2fa service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:03.854224 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-c98d8eaf-bdeb-43b2-8d1d-b143a0a15a15 req-f92fa535-104a-4f3f-bf9e-594429b1a2fa service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:03.872644 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-c98d8eaf-bdeb-43b2-8d1d-b143a0a15a15 req-f92fa535-104a-4f3f-bf9e-594429b1a2fa service nova] Creating event network-vif-plugged:67582d29-a79f-4ee2-8844-18b26e15268b for instance 3f043b14-af6f-4d95-a094-87fa6c768493 on hv-cinder-81080 Sep 24 03:32:03.889032 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-c98d8eaf-bdeb-43b2-8d1d-b143a0a15a15 req-f92fa535-104a-4f3f-bf9e-594429b1a2fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052531 Sep 24 03:32:03.915344 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 67/118] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:32:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:32:04.024390 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f73c96a3-fd6e-47fb-9469-67d8028de2c6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:04.025884 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f73c96a3-fd6e-47fb-9469-67d8028de2c6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:04.041264 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-02e7d028-3d3b-4648-9c66-28a6d911c4da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:04.042069 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-02e7d028-3d3b-4648-9c66-28a6d911c4da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:04.049827 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f73c96a3-fd6e-47fb-9469-67d8028de2c6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:04.051611 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02e7d028-3d3b-4648-9c66-28a6d911c4da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:04.052587 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f73c96a3-fd6e-47fb-9469-67d8028de2c6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:04.054249 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02e7d028-3d3b-4648-9c66-28a6d911c4da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:04.054384 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f73c96a3-fd6e-47fb-9469-67d8028de2c6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:04.055351 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02e7d028-3d3b-4648-9c66-28a6d911c4da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:04.056258 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f73c96a3-fd6e-47fb-9469-67d8028de2c6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:04.056866 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02e7d028-3d3b-4648-9c66-28a6d911c4da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:04.401243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-f73c96a3-fd6e-47fb-9469-67d8028de2c6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:04.412017 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f73c96a3-fd6e-47fb-9469-67d8028de2c6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1322 microversion: 2.1 time: 0.389642 Sep 24 03:32:04.416453 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-02e7d028-3d3b-4648-9c66-28a6d911c4da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:04.419812 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 52/119] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:04 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:04.428480 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-02e7d028-3d3b-4648-9c66-28a6d911c4da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:04.431293 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-02e7d028-3d3b-4648-9c66-28a6d911c4da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:04.435741 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ca86a42b-df84-4cd6-b91e-605e6d2d66e2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:04.438610 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-02e7d028-3d3b-4648-9c66-28a6d911c4da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1406 microversion: 2.20 time: 0.400492 Sep 24 03:32:04.439310 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 68/120] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:32:04 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1406 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:32:04.441041 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ca86a42b-df84-4cd6-b91e-605e6d2d66e2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:04.448344 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ca86a42b-df84-4cd6-b91e-605e6d2d66e2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:04.448766 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ca86a42b-df84-4cd6-b91e-605e6d2d66e2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:04.449705 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ca86a42b-df84-4cd6-b91e-605e6d2d66e2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:04.450343 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ca86a42b-df84-4cd6-b91e-605e6d2d66e2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:04.630436 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ca86a42b-df84-4cd6-b91e-605e6d2d66e2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 14 microversion: 2.1 time: 0.203338 Sep 24 03:32:04.633956 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 53/121] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:04 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 14 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:32:05.438204 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-273e105c-4688-4012-8119-7a9ee3f72233 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:05.438972 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-273e105c-4688-4012-8119-7a9ee3f72233 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:05.447327 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-273e105c-4688-4012-8119-7a9ee3f72233 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:05.448218 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-273e105c-4688-4012-8119-7a9ee3f72233 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:05.449639 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-273e105c-4688-4012-8119-7a9ee3f72233 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:05.450684 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-273e105c-4688-4012-8119-7a9ee3f72233 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:05.462931 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-09bdc309-7944-4012-8805-bb1b38844f3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:05.464741 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-09bdc309-7944-4012-8805-bb1b38844f3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:05.474382 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-09bdc309-7944-4012-8805-bb1b38844f3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:05.475287 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-09bdc309-7944-4012-8805-bb1b38844f3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:05.476273 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-09bdc309-7944-4012-8805-bb1b38844f3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:05.476700 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-09bdc309-7944-4012-8805-bb1b38844f3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:05.751612 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-273e105c-4688-4012-8119-7a9ee3f72233 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:05.768702 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-273e105c-4688-4012-8119-7a9ee3f72233 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1322 microversion: 2.1 time: 0.334786 Sep 24 03:32:05.774616 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-09bdc309-7944-4012-8805-bb1b38844f3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:05.775217 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 69/122] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:05 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:05.787974 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-19474f42-346a-48f6-b70d-f10e0ffb5630 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:05.788902 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-19474f42-346a-48f6-b70d-f10e0ffb5630 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:05.792490 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-09bdc309-7944-4012-8805-bb1b38844f3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:05.796163 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-09bdc309-7944-4012-8805-bb1b38844f3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:05.797970 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-09bdc309-7944-4012-8805-bb1b38844f3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1406 microversion: 2.20 time: 0.340767 Sep 24 03:32:05.798816 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 54/123] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:32:05 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1406 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:32:05.820587 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-19474f42-346a-48f6-b70d-f10e0ffb5630 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:05.821906 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-19474f42-346a-48f6-b70d-f10e0ffb5630 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:05.823329 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-19474f42-346a-48f6-b70d-f10e0ffb5630 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:05.823949 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-19474f42-346a-48f6-b70d-f10e0ffb5630 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:05.924200 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-19474f42-346a-48f6-b70d-f10e0ffb5630 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 14 microversion: 2.1 time: 0.147707 Sep 24 03:32:05.925113 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 70/124] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:05 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:32:05.945547 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-823f6ec5-3c0c-433d-bb8e-956b172888c4 req-ccb5d486-c91a-4163-a085-7956c3f55c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77091753-37d0-4ee1-9824-464b2bd4a70d", "name": "network-vif-plugged", "status": "completed", "tag": "2d1003e4-1b5a-4b64-a7bf-91ade75c29e4"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:05.947346 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:32:05.947346 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:32:05.958173 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-823f6ec5-3c0c-433d-bb8e-956b172888c4 req-ccb5d486-c91a-4163-a085-7956c3f55c1b service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:05.958736 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-823f6ec5-3c0c-433d-bb8e-956b172888c4 req-ccb5d486-c91a-4163-a085-7956c3f55c1b service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:05.982404 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-823f6ec5-3c0c-433d-bb8e-956b172888c4 req-ccb5d486-c91a-4163-a085-7956c3f55c1b service nova] Creating event network-vif-plugged:2d1003e4-1b5a-4b64-a7bf-91ade75c29e4 for instance 77091753-37d0-4ee1-9824-464b2bd4a70d on hv-cinder-81080 Sep 24 03:32:05.991722 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-823f6ec5-3c0c-433d-bb8e-956b172888c4 req-ccb5d486-c91a-4163-a085-7956c3f55c1b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050537 Sep 24 03:32:05.992839 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 55/125] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:32:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:32:06.012918 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-cb6a88f2-9a34-4756-bbff-32285e313d43 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:06.013500 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-cb6a88f2-9a34-4756-bbff-32285e313d43 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:06.020829 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cb6a88f2-9a34-4756-bbff-32285e313d43 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:06.021500 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cb6a88f2-9a34-4756-bbff-32285e313d43 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:06.022458 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cb6a88f2-9a34-4756-bbff-32285e313d43 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:06.023067 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cb6a88f2-9a34-4756-bbff-32285e313d43 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:06.057196 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-cb6a88f2-9a34-4756-bbff-32285e313d43 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Going to try to terminate instance {{(pid=109374) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:32:06.208086 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-cb6a88f2-9a34-4756-bbff-32285e313d43 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 204 len: 0 microversion: 2.1 time: 0.198617 Sep 24 03:32:06.209043 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 71/126] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:32:06 2021] DELETE /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:32:06.219013 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-320e81fb-fefe-4ffc-9d4f-7e4117daab69 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:06.219830 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-320e81fb-fefe-4ffc-9d4f-7e4117daab69 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:06.227427 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-320e81fb-fefe-4ffc-9d4f-7e4117daab69 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:06.228057 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-320e81fb-fefe-4ffc-9d4f-7e4117daab69 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:06.229328 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-320e81fb-fefe-4ffc-9d4f-7e4117daab69 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:06.229838 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-320e81fb-fefe-4ffc-9d4f-7e4117daab69 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:06.415730 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-320e81fb-fefe-4ffc-9d4f-7e4117daab69 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:06.424471 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-320e81fb-fefe-4ffc-9d4f-7e4117daab69 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1554 microversion: 2.1 time: 0.211330 Sep 24 03:32:06.434327 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 56/127] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:06 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:06.791723 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5062fb34-65b6-43a9-ad9e-6397b0fa0859 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:06.796003 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5062fb34-65b6-43a9-ad9e-6397b0fa0859 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:06.802640 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5062fb34-65b6-43a9-ad9e-6397b0fa0859 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:06.803313 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5062fb34-65b6-43a9-ad9e-6397b0fa0859 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:06.804588 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5062fb34-65b6-43a9-ad9e-6397b0fa0859 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:06.805211 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5062fb34-65b6-43a9-ad9e-6397b0fa0859 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:06.818384 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9a270fee-d3d4-492e-bf54-ad9408d701a3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:06.819635 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9a270fee-d3d4-492e-bf54-ad9408d701a3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:06.826257 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9a270fee-d3d4-492e-bf54-ad9408d701a3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:06.827809 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9a270fee-d3d4-492e-bf54-ad9408d701a3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:06.828767 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9a270fee-d3d4-492e-bf54-ad9408d701a3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:06.829370 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9a270fee-d3d4-492e-bf54-ad9408d701a3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:07.042451 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9a270fee-d3d4-492e-bf54-ad9408d701a3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:07.050692 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9a270fee-d3d4-492e-bf54-ad9408d701a3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:07.058813 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9a270fee-d3d4-492e-bf54-ad9408d701a3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:07.060012 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9a270fee-d3d4-492e-bf54-ad9408d701a3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1597 microversion: 2.20 time: 0.245720 Sep 24 03:32:07.061336 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 57/128] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:32:06 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1597 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:32:07.073073 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a672aa6e-a295-4e1a-be50-a49578fb25b9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:07.074294 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a672aa6e-a295-4e1a-be50-a49578fb25b9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:07.088591 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a672aa6e-a295-4e1a-be50-a49578fb25b9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:07.090992 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a672aa6e-a295-4e1a-be50-a49578fb25b9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:07.091976 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a672aa6e-a295-4e1a-be50-a49578fb25b9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:07.097016 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a672aa6e-a295-4e1a-be50-a49578fb25b9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:07.126663 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5062fb34-65b6-43a9-ad9e-6397b0fa0859 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:07.137914 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5062fb34-65b6-43a9-ad9e-6397b0fa0859 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1322 microversion: 2.1 time: 0.347178 Sep 24 03:32:07.138764 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 72/129] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:06 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:07.149492 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0b7f38fe-4a78-4932-9b75-670abcc03bbc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:07.150867 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0b7f38fe-4a78-4932-9b75-670abcc03bbc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:07.158562 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0b7f38fe-4a78-4932-9b75-670abcc03bbc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:07.159391 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0b7f38fe-4a78-4932-9b75-670abcc03bbc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:07.160926 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0b7f38fe-4a78-4932-9b75-670abcc03bbc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:07.161762 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0b7f38fe-4a78-4932-9b75-670abcc03bbc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:07.204604 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a672aa6e-a295-4e1a-be50-a49578fb25b9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 14 microversion: 2.1 time: 0.141603 Sep 24 03:32:07.207723 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 58/130] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:07 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:32:07.273541 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0b7f38fe-4a78-4932-9b75-670abcc03bbc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.133347 Sep 24 03:32:07.274179 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 73/131] 10.222.0.18 () {60 vars in 1316 bytes} [Fri Sep 24 03:32:07 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:32:07.443589 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f867131e-a0f3-49e7-8b90-bdaf688af9a0 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:07.444571 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f867131e-a0f3-49e7-8b90-bdaf688af9a0 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:07.453828 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f867131e-a0f3-49e7-8b90-bdaf688af9a0 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:07.454678 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f867131e-a0f3-49e7-8b90-bdaf688af9a0 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:07.455615 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f867131e-a0f3-49e7-8b90-bdaf688af9a0 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:07.456191 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f867131e-a0f3-49e7-8b90-bdaf688af9a0 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:07.676475 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-f867131e-a0f3-49e7-8b90-bdaf688af9a0 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:07.684262 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f867131e-a0f3-49e7-8b90-bdaf688af9a0 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1554 microversion: 2.1 time: 0.246036 Sep 24 03:32:07.685041 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 59/132] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:07 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1554 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:08.155049 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7128dda9-bacd-4a19-9843-930f5d0d5fbd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:08.155856 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-7128dda9-bacd-4a19-9843-930f5d0d5fbd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:08.166466 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7128dda9-bacd-4a19-9843-930f5d0d5fbd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:08.166919 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7128dda9-bacd-4a19-9843-930f5d0d5fbd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:08.167713 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7128dda9-bacd-4a19-9843-930f5d0d5fbd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:08.168158 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7128dda9-bacd-4a19-9843-930f5d0d5fbd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:08.214799 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-7f712099-c841-4404-b3b6-59a72f27cc2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:08.216101 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-7f712099-c841-4404-b3b6-59a72f27cc2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:08.222299 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7f712099-c841-4404-b3b6-59a72f27cc2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:08.222753 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7f712099-c841-4404-b3b6-59a72f27cc2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:08.223531 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7f712099-c841-4404-b3b6-59a72f27cc2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:08.232481 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7f712099-c841-4404-b3b6-59a72f27cc2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:08.369327 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-7f712099-c841-4404-b3b6-59a72f27cc2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 14 microversion: 2.1 time: 0.157812 Sep 24 03:32:08.372632 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 60/133] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:08 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 03:32:08.401368 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7128dda9-bacd-4a19-9843-930f5d0d5fbd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:08.409035 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7128dda9-bacd-4a19-9843-930f5d0d5fbd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1515 microversion: 2.1 time: 0.257900 Sep 24 03:32:08.409935 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 74/134] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:08 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:08.438086 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3d8cb05c-ff5c-4ce8-9a38-0fb7881e1fff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:08.439113 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3d8cb05c-ff5c-4ce8-9a38-0fb7881e1fff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:08.446610 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3d8cb05c-ff5c-4ce8-9a38-0fb7881e1fff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:08.447056 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3d8cb05c-ff5c-4ce8-9a38-0fb7881e1fff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:08.447942 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3d8cb05c-ff5c-4ce8-9a38-0fb7881e1fff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:08.448371 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3d8cb05c-ff5c-4ce8-9a38-0fb7881e1fff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:08.479654 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-3d8cb05c-ff5c-4ce8-9a38-0fb7881e1fff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lazy-loading 'flavor' on Instance uuid 77091753-37d0-4ee1-9824-464b2bd4a70d {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:32:08.688099 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3d8cb05c-ff5c-4ce8-9a38-0fb7881e1fff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "POST /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d/action" status: 200 len: 32 microversion: 2.1 time: 0.257842 Sep 24 03:32:08.689330 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 61/135] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:08 2021] POST /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:32:08.700970 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-746c32fb-284d-4d7d-bfe1-f57e2bc3d9b7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:08.702123 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-746c32fb-284d-4d7d-bfe1-f57e2bc3d9b7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:08.710979 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-18ba749d-cbd0-494c-a462-99928ae9eaf2 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:08.712025 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-18ba749d-cbd0-494c-a462-99928ae9eaf2 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:08.716897 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-746c32fb-284d-4d7d-bfe1-f57e2bc3d9b7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:08.721565 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-18ba749d-cbd0-494c-a462-99928ae9eaf2 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:08.722419 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-18ba749d-cbd0-494c-a462-99928ae9eaf2 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:08.723692 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-746c32fb-284d-4d7d-bfe1-f57e2bc3d9b7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:08.724384 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-18ba749d-cbd0-494c-a462-99928ae9eaf2 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:08.725090 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-18ba749d-cbd0-494c-a462-99928ae9eaf2 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:08.738016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-746c32fb-284d-4d7d-bfe1-f57e2bc3d9b7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:08.741453 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-746c32fb-284d-4d7d-bfe1-f57e2bc3d9b7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:09.299255 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-746c32fb-284d-4d7d-bfe1-f57e2bc3d9b7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:09.307650 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-746c32fb-284d-4d7d-bfe1-f57e2bc3d9b7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.612859 Sep 24 03:32:09.308840 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 75/136] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:08 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:09.314475 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-dfc43416-b82a-441f-8bdf-3377077e3fb6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:09.315679 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-dfc43416-b82a-441f-8bdf-3377077e3fb6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:09.332125 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dfc43416-b82a-441f-8bdf-3377077e3fb6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:09.332979 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dfc43416-b82a-441f-8bdf-3377077e3fb6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:09.333991 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dfc43416-b82a-441f-8bdf-3377077e3fb6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:09.334578 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dfc43416-b82a-441f-8bdf-3377077e3fb6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:09.376130 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-18ba749d-cbd0-494c-a462-99928ae9eaf2 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:09.385545 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-18ba749d-cbd0-494c-a462-99928ae9eaf2 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1554 microversion: 2.1 time: 0.679592 Sep 24 03:32:09.386261 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 62/137] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:08 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1554 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:09.400216 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-133010b6-f1c1-43bb-8f52-0a94c047ba6d req-56dab0aa-9ef8-4611-8065-cf5866e5863e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f043b14-af6f-4d95-a094-87fa6c768493", "tag": "67582d29-a79f-4ee2-8844-18b26e15268b"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:09.401180 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:32:09.401180 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:32:09.420864 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-133010b6-f1c1-43bb-8f52-0a94c047ba6d req-56dab0aa-9ef8-4611-8065-cf5866e5863e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:09.421403 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-133010b6-f1c1-43bb-8f52-0a94c047ba6d req-56dab0aa-9ef8-4611-8065-cf5866e5863e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:09.435498 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-133010b6-f1c1-43bb-8f52-0a94c047ba6d req-56dab0aa-9ef8-4611-8065-cf5866e5863e service nova] Creating event network-changed:67582d29-a79f-4ee2-8844-18b26e15268b for instance 3f043b14-af6f-4d95-a094-87fa6c768493 on hv-cinder-81080 Sep 24 03:32:09.442566 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-133010b6-f1c1-43bb-8f52-0a94c047ba6d req-56dab0aa-9ef8-4611-8065-cf5866e5863e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054823 Sep 24 03:32:09.443195 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 63/138] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:32:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:32:09.447143 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-dfc43416-b82a-441f-8bdf-3377077e3fb6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 14 microversion: 2.20 time: 0.136635 Sep 24 03:32:09.447659 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 76/139] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:09 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:09.448669 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-fce33e8f-bbc1-42db-8849-655cf1ceda9d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:09.449548 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-fce33e8f-bbc1-42db-8849-655cf1ceda9d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:09.458531 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fce33e8f-bbc1-42db-8849-655cf1ceda9d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:09.459118 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fce33e8f-bbc1-42db-8849-655cf1ceda9d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:09.460050 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fce33e8f-bbc1-42db-8849-655cf1ceda9d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:09.460638 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fce33e8f-bbc1-42db-8849-655cf1ceda9d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:09.598185 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-fce33e8f-bbc1-42db-8849-655cf1ceda9d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 14 microversion: 2.1 time: 0.153384 Sep 24 03:32:09.599328 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 64/140] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:09 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:32:10.325601 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ef700a3a-6ddf-413d-b145-871d9c064e35 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:10.326763 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ef700a3a-6ddf-413d-b145-871d9c064e35 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:10.344450 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ef700a3a-6ddf-413d-b145-871d9c064e35 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:10.345075 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ef700a3a-6ddf-413d-b145-871d9c064e35 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:10.345959 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ef700a3a-6ddf-413d-b145-871d9c064e35 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:10.346386 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ef700a3a-6ddf-413d-b145-871d9c064e35 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:10.419357 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-29323f54-6dc2-44a1-b82a-2c3162af806f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:10.421936 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-29323f54-6dc2-44a1-b82a-2c3162af806f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:10.428819 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-29323f54-6dc2-44a1-b82a-2c3162af806f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:10.432862 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-29323f54-6dc2-44a1-b82a-2c3162af806f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:10.433768 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-29323f54-6dc2-44a1-b82a-2c3162af806f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:10.434376 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-29323f54-6dc2-44a1-b82a-2c3162af806f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:10.570837 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-29323f54-6dc2-44a1-b82a-2c3162af806f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:10.586593 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-29323f54-6dc2-44a1-b82a-2c3162af806f tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1512 microversion: 2.1 time: 0.173294 Sep 24 03:32:10.587623 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 65/141] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:10 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:10.597306 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9b48573a-19dd-4d9a-8d76-5663ca804293 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:10.599263 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9b48573a-19dd-4d9a-8d76-5663ca804293 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:10.613582 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9b48573a-19dd-4d9a-8d76-5663ca804293 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:10.616912 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9b48573a-19dd-4d9a-8d76-5663ca804293 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:10.617976 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9b48573a-19dd-4d9a-8d76-5663ca804293 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:10.618756 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9b48573a-19dd-4d9a-8d76-5663ca804293 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:10.683609 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ef700a3a-6ddf-413d-b145-871d9c064e35 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:10.691058 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9b48573a-19dd-4d9a-8d76-5663ca804293 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 14 microversion: 2.20 time: 0.101057 Sep 24 03:32:10.691850 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 66/142] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:10 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:10.693773 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ef700a3a-6ddf-413d-b145-871d9c064e35 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.372503 Sep 24 03:32:10.695191 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 77/143] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:10 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:10.705801 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-615fe6e2-1902-47c6-b3aa-743dfb6604fc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:10.705801 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-615fe6e2-1902-47c6-b3aa-743dfb6604fc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:10.709586 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-615fe6e2-1902-47c6-b3aa-743dfb6604fc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:10.710158 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-615fe6e2-1902-47c6-b3aa-743dfb6604fc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:10.710888 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-615fe6e2-1902-47c6-b3aa-743dfb6604fc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:10.711630 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-615fe6e2-1902-47c6-b3aa-743dfb6604fc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:10.717829 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-c6aa5b0a-f080-4fe3-af47-3d19ec5a5091 req-a62bce22-deb5-415d-9976-b02c3cab868c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3540174-f6bf-49ec-a73f-a6c97f75cb0c", "name": "network-vif-deleted", "tag": "e3ce4347-79c9-4ad9-879b-fbbcc74060cc"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:10.720154 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:32:10.720154 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:32:10.731245 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-c6aa5b0a-f080-4fe3-af47-3d19ec5a5091 req-a62bce22-deb5-415d-9976-b02c3cab868c service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:10.732177 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-c6aa5b0a-f080-4fe3-af47-3d19ec5a5091 req-a62bce22-deb5-415d-9976-b02c3cab868c service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:10.745983 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-c6aa5b0a-f080-4fe3-af47-3d19ec5a5091 req-a62bce22-deb5-415d-9976-b02c3cab868c service nova] Creating event network-vif-deleted:e3ce4347-79c9-4ad9-879b-fbbcc74060cc for instance e3540174-f6bf-49ec-a73f-a6c97f75cb0c on hv-cinder-81080 Sep 24 03:32:10.753518 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-c6aa5b0a-f080-4fe3-af47-3d19ec5a5091 req-a62bce22-deb5-415d-9976-b02c3cab868c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045606 Sep 24 03:32:10.754380 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 78/144] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:32:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:32:11.603686 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8f3dbe0e-4b48-4bb0-8e1f-db8039869922 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:11.604403 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8f3dbe0e-4b48-4bb0-8e1f-db8039869922 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:11.612457 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8f3dbe0e-4b48-4bb0-8e1f-db8039869922 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:11.612898 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8f3dbe0e-4b48-4bb0-8e1f-db8039869922 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:11.613663 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8f3dbe0e-4b48-4bb0-8e1f-db8039869922 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:11.614128 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8f3dbe0e-4b48-4bb0-8e1f-db8039869922 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:11.683267 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8f3dbe0e-4b48-4bb0-8e1f-db8039869922 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:11.691276 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8f3dbe0e-4b48-4bb0-8e1f-db8039869922 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1346 microversion: 2.1 time: 0.091642 Sep 24 03:32:11.691854 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 79/145] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:11 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:11.701978 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-131f6855-b0de-4e74-b89e-2c1b725abf14 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:11.702803 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-131f6855-b0de-4e74-b89e-2c1b725abf14 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:11.708831 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-131f6855-b0de-4e74-b89e-2c1b725abf14 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:11.709267 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-131f6855-b0de-4e74-b89e-2c1b725abf14 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:11.710058 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-131f6855-b0de-4e74-b89e-2c1b725abf14 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:11.710502 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-131f6855-b0de-4e74-b89e-2c1b725abf14 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:14.182659 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-131f6855-b0de-4e74-b89e-2c1b725abf14 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 14 microversion: 2.20 time: 2.484178 Sep 24 03:32:14.183434 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 80/146] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:11 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 14 bytes in 2486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:14.188902 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-dad21ff6-df31-49fa-8db5-d7798970e6a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:14.189976 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-dad21ff6-df31-49fa-8db5-d7798970e6a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:14.192976 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-615fe6e2-1902-47c6-b3aa-743dfb6604fc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 14 microversion: 2.1 time: 3.498590 Sep 24 03:32:14.196381 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 67/147] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:10 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 14 bytes in 3501 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:32:14.196559 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dad21ff6-df31-49fa-8db5-d7798970e6a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:14.196997 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dad21ff6-df31-49fa-8db5-d7798970e6a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:14.197809 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dad21ff6-df31-49fa-8db5-d7798970e6a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:14.198238 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dad21ff6-df31-49fa-8db5-d7798970e6a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:14.199685 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3c52ab28-3489-4ffd-b72e-266c1e9f7294 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:14.200371 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3c52ab28-3489-4ffd-b72e-266c1e9f7294 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:14.209074 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3c52ab28-3489-4ffd-b72e-266c1e9f7294 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:14.209515 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3c52ab28-3489-4ffd-b72e-266c1e9f7294 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:14.210393 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3c52ab28-3489-4ffd-b72e-266c1e9f7294 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:14.210876 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3c52ab28-3489-4ffd-b72e-266c1e9f7294 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:14.290021 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-3c52ab28-3489-4ffd-b72e-266c1e9f7294 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:14.298328 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3c52ab28-3489-4ffd-b72e-266c1e9f7294 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1346 microversion: 2.1 time: 0.103321 Sep 24 03:32:14.299215 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 68/148] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:14 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:14.345336 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-dad21ff6-df31-49fa-8db5-d7798970e6a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:14.352617 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-dad21ff6-df31-49fa-8db5-d7798970e6a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.167892 Sep 24 03:32:14.353182 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 81/149] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:14 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:15.192744 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ccb1776e-9b9b-4043-8b43-981e30b2409c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:15.193695 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ccb1776e-9b9b-4043-8b43-981e30b2409c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:15.199466 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ccb1776e-9b9b-4043-8b43-981e30b2409c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:15.199908 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ccb1776e-9b9b-4043-8b43-981e30b2409c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:15.200668 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ccb1776e-9b9b-4043-8b43-981e30b2409c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:15.201091 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ccb1776e-9b9b-4043-8b43-981e30b2409c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:15.204535 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-606d576f-9792-4314-80e0-d17ee7bb2e4c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:15.205434 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-606d576f-9792-4314-80e0-d17ee7bb2e4c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:15.211595 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-606d576f-9792-4314-80e0-d17ee7bb2e4c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:15.212173 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-606d576f-9792-4314-80e0-d17ee7bb2e4c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:15.212989 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-606d576f-9792-4314-80e0-d17ee7bb2e4c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:15.213410 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-606d576f-9792-4314-80e0-d17ee7bb2e4c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:18.570186 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-606d576f-9792-4314-80e0-d17ee7bb2e4c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 6520 microversion: 2.1 time: 3.369720 Sep 24 03:32:18.570824 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 82/150] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:15 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 6520 bytes in 3371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:18.575424 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-60f93baa-ca68-43dc-b7d0-78ab53b0c1f1 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:18.576138 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-60f93baa-ca68-43dc-b7d0-78ab53b0c1f1 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:18.583051 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60f93baa-ca68-43dc-b7d0-78ab53b0c1f1 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:18.583493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60f93baa-ca68-43dc-b7d0-78ab53b0c1f1 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:18.584253 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60f93baa-ca68-43dc-b7d0-78ab53b0c1f1 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:18.584676 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60f93baa-ca68-43dc-b7d0-78ab53b0c1f1 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:18.594779 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ccb1776e-9b9b-4043-8b43-981e30b2409c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 14 microversion: 2.20 time: 3.405587 Sep 24 03:32:18.597963 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 69/151] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:15 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 14 bytes in 3407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:18.600132 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-55ffafe6-517c-4164-bd82-0df66ac897b4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:18.600840 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-55ffafe6-517c-4164-bd82-0df66ac897b4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:18.608225 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-55ffafe6-517c-4164-bd82-0df66ac897b4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:18.608666 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-55ffafe6-517c-4164-bd82-0df66ac897b4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:18.611608 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-55ffafe6-517c-4164-bd82-0df66ac897b4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:18.611608 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-55ffafe6-517c-4164-bd82-0df66ac897b4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:18.618441 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60f93baa-ca68-43dc-b7d0-78ab53b0c1f1 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:18.618886 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60f93baa-ca68-43dc-b7d0-78ab53b0c1f1 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:18.619358 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.objects.instance [None req-60f93baa-ca68-43dc-b7d0-78ab53b0c1f1 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lazy-loading 'fault' on Instance uuid e3540174-f6bf-49ec-a73f-a6c97f75cb0c {{(pid=109374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:32:18.666960 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-60f93baa-ca68-43dc-b7d0-78ab53b0c1f1 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912886a1dda6489c9bd8044116c8a16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3f7c20fdf04a49852b5b836d442f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:18.676670 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-60f93baa-ca68-43dc-b7d0-78ab53b0c1f1 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 200 len: 1351 microversion: 2.1 time: 0.104750 Sep 24 03:32:18.677359 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 83/152] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:18 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:18.760961 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-55ffafe6-517c-4164-bd82-0df66ac897b4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:18.769066 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-55ffafe6-517c-4164-bd82-0df66ac897b4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.172363 Sep 24 03:32:18.769839 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 70/153] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:18 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:19.420560 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1988747633", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "networks": [{"uuid": "da8a83a1-4718-4b4d-b03f-5ba6c433eea0"}]}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:19.474089 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.network.neutron [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] validate_networks() for [('da8a83a1-4718-4b4d-b03f-5ba6c433eea0', None, None, None, None, None)] {{(pid=109374) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:32:19.580460 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9245d5d0-ae71-4d46-817a-bd00383e5e88 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:19.581557 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9245d5d0-ae71-4d46-817a-bd00383e5e88 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:19.587406 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9245d5d0-ae71-4d46-817a-bd00383e5e88 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:19.587845 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9245d5d0-ae71-4d46-817a-bd00383e5e88 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:19.588611 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9245d5d0-ae71-4d46-817a-bd00383e5e88 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:19.589038 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9245d5d0-ae71-4d46-817a-bd00383e5e88 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:19.691861 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9245d5d0-ae71-4d46-817a-bd00383e5e88 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 11454 microversion: 2.1 time: 0.114919 Sep 24 03:32:19.693496 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 71/154] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:19 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 11454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:32:19.699201 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b9b631f9-8e60-46a1-800e-fc38058456d6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:19.700187 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b9b631f9-8e60-46a1-800e-fc38058456d6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:19.707617 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b9b631f9-8e60-46a1-800e-fc38058456d6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:19.708052 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b9b631f9-8e60-46a1-800e-fc38058456d6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:19.708817 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b9b631f9-8e60-46a1-800e-fc38058456d6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:19.709237 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b9b631f9-8e60-46a1-800e-fc38058456d6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:19.789682 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b9b631f9-8e60-46a1-800e-fc38058456d6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 14 microversion: 2.20 time: 0.094517 Sep 24 03:32:19.790707 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 72/155] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:19 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:19.796775 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-54d3c8da-3f05-415a-9460-1a5f9126e309 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:19.797478 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-54d3c8da-3f05-415a-9460-1a5f9126e309 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:19.804071 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-54d3c8da-3f05-415a-9460-1a5f9126e309 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:19.804518 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-54d3c8da-3f05-415a-9460-1a5f9126e309 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:19.805278 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-54d3c8da-3f05-415a-9460-1a5f9126e309 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:19.805727 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-54d3c8da-3f05-415a-9460-1a5f9126e309 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:19.823541 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-54d3c8da-3f05-415a-9460-1a5f9126e309 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] HTTP exception thrown: Instance e3540174-f6bf-49ec-a73f-a6c97f75cb0c could not be found. Sep 24 03:32:19.824898 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-54d3c8da-3f05-415a-9460-1a5f9126e309 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Returning 404 to user: Instance e3540174-f6bf-49ec-a73f-a6c97f75cb0c could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:32:19.825837 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-54d3c8da-3f05-415a-9460-1a5f9126e309 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 404 len: 111 microversion: 2.1 time: 0.033843 Sep 24 03:32:19.827680 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 73/156] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:19 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:32:19.837121 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-84ccd762-25b3-4061-8e57-1630556cd6fd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:19.837744 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-84ccd762-25b3-4061-8e57-1630556cd6fd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:19.845015 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-84ccd762-25b3-4061-8e57-1630556cd6fd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:19.845460 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-84ccd762-25b3-4061-8e57-1630556cd6fd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:19.846261 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-84ccd762-25b3-4061-8e57-1630556cd6fd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:19.846689 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-84ccd762-25b3-4061-8e57-1630556cd6fd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:20.081803 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-84ccd762-25b3-4061-8e57-1630556cd6fd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:20.085790 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Flavor limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:32:20.086710 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Image limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:32:20.087385 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Flavor pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:32:20.087836 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Image pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:32:20.088360 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:32:20.089043 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-84ccd762-25b3-4061-8e57-1630556cd6fd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.255615 Sep 24 03:32:20.089616 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 74/157] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:19 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:20.094810 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8973cd65-e3c1-4531-a5bb-b1bdee60e59a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:20.095934 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8973cd65-e3c1-4531-a5bb-b1bdee60e59a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:20.102319 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:20.102477 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8973cd65-e3c1-4531-a5bb-b1bdee60e59a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:20.102779 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8973cd65-e3c1-4531-a5bb-b1bdee60e59a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:20.102925 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:20.103832 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:20.104188 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:20.104486 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8973cd65-e3c1-4531-a5bb-b1bdee60e59a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:20.105064 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8973cd65-e3c1-4531-a5bb-b1bdee60e59a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:20.122537 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Getting quotas for project cad76815db3c4a67adf42217edb51d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:32:20.125034 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-8973cd65-e3c1-4531-a5bb-b1bdee60e59a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] HTTP exception thrown: Instance e3540174-f6bf-49ec-a73f-a6c97f75cb0c could not be found. Sep 24 03:32:20.125619 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8973cd65-e3c1-4531-a5bb-b1bdee60e59a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Returning 404 to user: Instance e3540174-f6bf-49ec-a73f-a6c97f75cb0c could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:32:20.126496 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8973cd65-e3c1-4531-a5bb-b1bdee60e59a tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035803 Sep 24 03:32:20.127049 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 75/158] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:32:20 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:32:20.127649 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Getting quotas for user 332a6e416a1347d8927b2d48cc37ac37 and project cad76815db3c4a67adf42217edb51d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:32:20.140346 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Going to run 1 instances... {{(pid=109374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:32:20.142791 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:32:20.202684 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b96ba10c-2225-4781-a137-1e4626412e33 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785655 Sep 24 03:32:20.204105 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 84/159] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:32:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:32:20.214095 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8110bd0c-840e-4de5-b714-ded7554b8534 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:20.214714 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8110bd0c-840e-4de5-b714-ded7554b8534 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:20.285254 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8110bd0c-840e-4de5-b714-ded7554b8534 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:20.292488 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8110bd0c-840e-4de5-b714-ded7554b8534 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 200 len: 1218 microversion: 2.1 time: 0.082556 Sep 24 03:32:20.293103 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 76/160] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:20 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:20.704466 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1278d39e-d5bf-4a6f-8e68-6dfb0e2beb4d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:20.705480 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1278d39e-d5bf-4a6f-8e68-6dfb0e2beb4d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:20.712027 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1278d39e-d5bf-4a6f-8e68-6dfb0e2beb4d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:20.713274 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1278d39e-d5bf-4a6f-8e68-6dfb0e2beb4d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:20.714262 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1278d39e-d5bf-4a6f-8e68-6dfb0e2beb4d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:20.714693 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1278d39e-d5bf-4a6f-8e68-6dfb0e2beb4d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:20.801542 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1278d39e-d5bf-4a6f-8e68-6dfb0e2beb4d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 15184 microversion: 2.1 time: 0.101352 Sep 24 03:32:20.802390 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-64aff058-8b8f-41ff-ad19-afd8c07ec625 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:20.802932 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 85/161] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:20 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 15184 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:32:20.804235 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-64aff058-8b8f-41ff-ad19-afd8c07ec625 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:20.811366 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-64aff058-8b8f-41ff-ad19-afd8c07ec625 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:20.811804 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-64aff058-8b8f-41ff-ad19-afd8c07ec625 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:20.812565 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-64aff058-8b8f-41ff-ad19-afd8c07ec625 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:20.813098 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-64aff058-8b8f-41ff-ad19-afd8c07ec625 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:20.907083 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-64aff058-8b8f-41ff-ad19-afd8c07ec625 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 14 microversion: 2.20 time: 0.109325 Sep 24 03:32:20.908276 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 77/162] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:20 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:21.111301 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2226ed5e-5354-4b43-8332-6413b9d0c9b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:21.112243 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2226ed5e-5354-4b43-8332-6413b9d0c9b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:21.120366 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2226ed5e-5354-4b43-8332-6413b9d0c9b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:21.121817 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2226ed5e-5354-4b43-8332-6413b9d0c9b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:21.122636 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2226ed5e-5354-4b43-8332-6413b9d0c9b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:21.123754 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2226ed5e-5354-4b43-8332-6413b9d0c9b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:21.274597 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2226ed5e-5354-4b43-8332-6413b9d0c9b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:21.283546 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2226ed5e-5354-4b43-8332-6413b9d0c9b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.177009 Sep 24 03:32:21.284289 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 86/163] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:21 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:21.310893 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-84182c9a-b001-475d-8d60-c320fc4d187b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:21.312182 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-84182c9a-b001-475d-8d60-c320fc4d187b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:21.318798 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-84182c9a-b001-475d-8d60-c320fc4d187b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:21.319243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-84182c9a-b001-475d-8d60-c320fc4d187b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:21.320011 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-84182c9a-b001-475d-8d60-c320fc4d187b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:21.320441 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-84182c9a-b001-475d-8d60-c320fc4d187b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:21.402651 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-84182c9a-b001-475d-8d60-c320fc4d187b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:21.415181 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-84182c9a-b001-475d-8d60-c320fc4d187b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 200 len: 1270 microversion: 2.1 time: 0.108850 Sep 24 03:32:21.428341 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 78/164] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:21 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:21.429734 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-03843dae-bac8-46aa-b889-96f5e726a91c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:21.430227 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-03843dae-bac8-46aa-b889-96f5e726a91c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:21.437819 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-03843dae-bac8-46aa-b889-96f5e726a91c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:21.439152 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-03843dae-bac8-46aa-b889-96f5e726a91c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:21.443443 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-03843dae-bac8-46aa-b889-96f5e726a91c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:21.444071 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-03843dae-bac8-46aa-b889-96f5e726a91c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:21.482023 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-03843dae-bac8-46aa-b889-96f5e726a91c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] HTTP exception thrown: Instance e3540174-f6bf-49ec-a73f-a6c97f75cb0c could not be found. Sep 24 03:32:21.486662 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-03843dae-bac8-46aa-b889-96f5e726a91c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Returning 404 to user: Instance e3540174-f6bf-49ec-a73f-a6c97f75cb0c could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:32:21.488239 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-03843dae-bac8-46aa-b889-96f5e726a91c tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 404 len: 111 microversion: 2.1 time: 0.062092 Sep 24 03:32:21.489024 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 87/165] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:32:21 2021] DELETE /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:32:21.499802 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9464b343-9ba4-4d44-b63d-e8b9b3e06da6 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:21.500494 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9464b343-9ba4-4d44-b63d-e8b9b3e06da6 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] [instance: e3540174-f6bf-49ec-a73f-a6c97f75cb0c] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:21.508684 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9464b343-9ba4-4d44-b63d-e8b9b3e06da6 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:21.509585 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9464b343-9ba4-4d44-b63d-e8b9b3e06da6 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:21.510805 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9464b343-9ba4-4d44-b63d-e8b9b3e06da6 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:21.511551 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9464b343-9ba4-4d44-b63d-e8b9b3e06da6 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:21.530894 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-9464b343-9ba4-4d44-b63d-e8b9b3e06da6 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] HTTP exception thrown: Instance e3540174-f6bf-49ec-a73f-a6c97f75cb0c could not be found. Sep 24 03:32:21.531958 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9464b343-9ba4-4d44-b63d-e8b9b3e06da6 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] Returning 404 to user: Instance e3540174-f6bf-49ec-a73f-a6c97f75cb0c could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:32:21.533376 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9464b343-9ba4-4d44-b63d-e8b9b3e06da6 tempest-DeleteServersTestJSON-895917086 tempest-DeleteServersTestJSON-895917086-project] 10.222.0.18 "GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c" status: 404 len: 111 microversion: 2.1 time: 0.039377 Sep 24 03:32:21.534229 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 79/166] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:21 2021] GET /compute/v2.1/servers/e3540174-f6bf-49ec-a73f-a6c97f75cb0c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:32:21.812985 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-34d3e0b3-c04e-45ae-88f4-ef8b2d022071 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:21.814159 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-34d3e0b3-c04e-45ae-88f4-ef8b2d022071 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:21.821366 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34d3e0b3-c04e-45ae-88f4-ef8b2d022071 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:21.822059 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34d3e0b3-c04e-45ae-88f4-ef8b2d022071 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:21.822977 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34d3e0b3-c04e-45ae-88f4-ef8b2d022071 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:21.823413 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34d3e0b3-c04e-45ae-88f4-ef8b2d022071 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:21.920558 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5129def7-261d-46c5-ae13-7e3b040e84c3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:21.923673 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5129def7-261d-46c5-ae13-7e3b040e84c3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:21.937735 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5129def7-261d-46c5-ae13-7e3b040e84c3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:21.938191 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5129def7-261d-46c5-ae13-7e3b040e84c3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:21.940185 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5129def7-261d-46c5-ae13-7e3b040e84c3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:21.944201 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5129def7-261d-46c5-ae13-7e3b040e84c3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:21.963594 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-34d3e0b3-c04e-45ae-88f4-ef8b2d022071 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 17933 microversion: 2.1 time: 0.154758 Sep 24 03:32:21.968475 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 88/167] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:21 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 17933 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:32:22.067577 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5129def7-261d-46c5-ae13-7e3b040e84c3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 14 microversion: 2.20 time: 0.152266 Sep 24 03:32:22.068493 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 80/168] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:21 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:22.301641 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-921f040d-1ce3-449f-81a4-eb104d9a2d58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:22.303089 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-921f040d-1ce3-449f-81a4-eb104d9a2d58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:22.316782 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-921f040d-1ce3-449f-81a4-eb104d9a2d58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:22.317415 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-921f040d-1ce3-449f-81a4-eb104d9a2d58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:22.318926 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-921f040d-1ce3-449f-81a4-eb104d9a2d58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:22.319637 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-921f040d-1ce3-449f-81a4-eb104d9a2d58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:22.437587 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f3da0845-099f-4d99-982a-afac0a319c24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:22.438311 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f3da0845-099f-4d99-982a-afac0a319c24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:22.445438 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f3da0845-099f-4d99-982a-afac0a319c24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:22.446237 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f3da0845-099f-4d99-982a-afac0a319c24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:22.447363 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f3da0845-099f-4d99-982a-afac0a319c24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:22.447995 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f3da0845-099f-4d99-982a-afac0a319c24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:22.667598 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-921f040d-1ce3-449f-81a4-eb104d9a2d58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:22.677176 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-921f040d-1ce3-449f-81a4-eb104d9a2d58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.379512 Sep 24 03:32:22.688656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 89/169] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:22 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:22.819620 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-f3da0845-099f-4d99-982a-afac0a319c24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:22.828022 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f3da0845-099f-4d99-982a-afac0a319c24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 200 len: 1318 microversion: 2.1 time: 0.396132 Sep 24 03:32:22.828590 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 81/170] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:22 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:22.976263 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-be03f8bf-800a-401b-bf6d-5c6411c94a7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:22.977191 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-be03f8bf-800a-401b-bf6d-5c6411c94a7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:22.993637 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-be03f8bf-800a-401b-bf6d-5c6411c94a7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:22.995508 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-be03f8bf-800a-401b-bf6d-5c6411c94a7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:23.003399 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-be03f8bf-800a-401b-bf6d-5c6411c94a7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:23.004097 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-be03f8bf-800a-401b-bf6d-5c6411c94a7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:23.079572 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-0a23632e-a65e-4fe4-9208-7bcfbb70a440 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:23.080488 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-0a23632e-a65e-4fe4-9208-7bcfbb70a440 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:23.086637 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0a23632e-a65e-4fe4-9208-7bcfbb70a440 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:23.087088 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0a23632e-a65e-4fe4-9208-7bcfbb70a440 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:23.087865 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0a23632e-a65e-4fe4-9208-7bcfbb70a440 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:23.088297 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0a23632e-a65e-4fe4-9208-7bcfbb70a440 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:26.336220 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-be03f8bf-800a-401b-bf6d-5c6411c94a7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 20173 microversion: 2.1 time: 3.363745 Sep 24 03:32:26.340957 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 90/171] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:22 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 20173 bytes in 3369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:32:26.347247 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-d9695a9a-3950-4ad0-9bf3-ca8997c95501 req-023313ef-eddc-4995-afa2-87594651b429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e82aa7-3e22-4ec6-84e7-6042f04eb89f", "tag": "ea6cc573-5c51-43c0-abd7-1bce694ffedf"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:26.348548 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:32:26.348548 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:32:26.356087 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-d9695a9a-3950-4ad0-9bf3-ca8997c95501 req-023313ef-eddc-4995-afa2-87594651b429 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:26.356522 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-d9695a9a-3950-4ad0-9bf3-ca8997c95501 req-023313ef-eddc-4995-afa2-87594651b429 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:26.372973 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-d9695a9a-3950-4ad0-9bf3-ca8997c95501 req-023313ef-eddc-4995-afa2-87594651b429 service nova] Creating event network-changed:ea6cc573-5c51-43c0-abd7-1bce694ffedf for instance 53e82aa7-3e22-4ec6-84e7-6042f04eb89f on hv-cinder-81080 Sep 24 03:32:26.372973 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-d9695a9a-3950-4ad0-9bf3-ca8997c95501 req-023313ef-eddc-4995-afa2-87594651b429 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030766 Sep 24 03:32:26.373643 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 91/172] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:32:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:32:26.379120 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e6eb3a99-c95c-4471-ab97-7ca5e608a500 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:26.379812 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e6eb3a99-c95c-4471-ab97-7ca5e608a500 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:26.386228 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e6eb3a99-c95c-4471-ab97-7ca5e608a500 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:26.386603 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e6eb3a99-c95c-4471-ab97-7ca5e608a500 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:26.387370 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e6eb3a99-c95c-4471-ab97-7ca5e608a500 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:26.387853 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e6eb3a99-c95c-4471-ab97-7ca5e608a500 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:26.428185 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-0a23632e-a65e-4fe4-9208-7bcfbb70a440 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 14 microversion: 2.20 time: 3.352976 Sep 24 03:32:26.428840 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 82/173] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:23 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 14 bytes in 3355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:26.434371 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9da76d80-7cd3-4681-9dde-4875d31f0e56 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:26.435368 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9da76d80-7cd3-4681-9dde-4875d31f0e56 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:26.442807 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9da76d80-7cd3-4681-9dde-4875d31f0e56 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:26.443533 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9da76d80-7cd3-4681-9dde-4875d31f0e56 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:26.444870 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9da76d80-7cd3-4681-9dde-4875d31f0e56 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:26.445746 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9da76d80-7cd3-4681-9dde-4875d31f0e56 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:26.666092 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e6eb3a99-c95c-4471-ab97-7ca5e608a500 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:26.679420 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e6eb3a99-c95c-4471-ab97-7ca5e608a500 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.303648 Sep 24 03:32:26.690447 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 92/174] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:26 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:26.767808 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9da76d80-7cd3-4681-9dde-4875d31f0e56 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:26.775320 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9da76d80-7cd3-4681-9dde-4875d31f0e56 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 200 len: 1318 microversion: 2.1 time: 0.345011 Sep 24 03:32:26.775904 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 83/175] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:26 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:27.349050 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-99880c3c-f6e6-4dc2-bebf-2d84ccf4de3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:27.350165 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-99880c3c-f6e6-4dc2-bebf-2d84ccf4de3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:27.357492 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-99880c3c-f6e6-4dc2-bebf-2d84ccf4de3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:27.359820 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-99880c3c-f6e6-4dc2-bebf-2d84ccf4de3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:27.362374 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-99880c3c-f6e6-4dc2-bebf-2d84ccf4de3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:27.364610 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-99880c3c-f6e6-4dc2-bebf-2d84ccf4de3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:27.439524 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-37d5129b-bb22-4d8b-848e-8d0a4f0a12ad tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:27.441017 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-37d5129b-bb22-4d8b-848e-8d0a4f0a12ad tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:27.448129 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-37d5129b-bb22-4d8b-848e-8d0a4f0a12ad tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:27.448764 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-37d5129b-bb22-4d8b-848e-8d0a4f0a12ad tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:27.449706 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-37d5129b-bb22-4d8b-848e-8d0a4f0a12ad tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:27.450336 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-37d5129b-bb22-4d8b-848e-8d0a4f0a12ad tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:27.486983 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-99880c3c-f6e6-4dc2-bebf-2d84ccf4de3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 22838 microversion: 2.1 time: 0.142305 Sep 24 03:32:27.487892 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 93/176] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:27 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 22838 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:32:27.540779 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-37d5129b-bb22-4d8b-848e-8d0a4f0a12ad tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 14 microversion: 2.20 time: 0.105868 Sep 24 03:32:27.541997 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 84/177] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:27 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:27.698672 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-11e7f210-608a-4944-9254-0f324d6c802e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:27.699717 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-11e7f210-608a-4944-9254-0f324d6c802e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:27.710709 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-11e7f210-608a-4944-9254-0f324d6c802e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:27.711514 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-11e7f210-608a-4944-9254-0f324d6c802e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:27.712309 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-11e7f210-608a-4944-9254-0f324d6c802e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:27.712935 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-11e7f210-608a-4944-9254-0f324d6c802e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:27.797464 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b854e9f6-3f29-404d-9395-8828883ec17c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:27.799102 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b854e9f6-3f29-404d-9395-8828883ec17c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:27.808275 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b854e9f6-3f29-404d-9395-8828883ec17c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:27.808788 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b854e9f6-3f29-404d-9395-8828883ec17c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:27.810198 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b854e9f6-3f29-404d-9395-8828883ec17c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:27.810198 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b854e9f6-3f29-404d-9395-8828883ec17c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:27.899122 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-11e7f210-608a-4944-9254-0f324d6c802e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:27.909264 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-11e7f210-608a-4944-9254-0f324d6c802e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.214614 Sep 24 03:32:27.910109 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 94/178] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:27 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:27.980462 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b854e9f6-3f29-404d-9395-8828883ec17c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:27.989282 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b854e9f6-3f29-404d-9395-8828883ec17c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 200 len: 1318 microversion: 2.1 time: 0.197401 Sep 24 03:32:27.990012 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 85/179] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:27 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:28.500792 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5a22589f-e8cc-4fc2-a947-753b27c49491 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:28.501810 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5a22589f-e8cc-4fc2-a947-753b27c49491 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:28.507678 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5a22589f-e8cc-4fc2-a947-753b27c49491 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:28.508117 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5a22589f-e8cc-4fc2-a947-753b27c49491 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:28.508870 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5a22589f-e8cc-4fc2-a947-753b27c49491 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:28.509293 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5a22589f-e8cc-4fc2-a947-753b27c49491 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:28.552121 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2df3f35c-e059-4045-94db-585d85ebb564 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:28.553108 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2df3f35c-e059-4045-94db-585d85ebb564 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:28.559158 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2df3f35c-e059-4045-94db-585d85ebb564 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:28.559607 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2df3f35c-e059-4045-94db-585d85ebb564 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:28.560372 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2df3f35c-e059-4045-94db-585d85ebb564 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:28.560802 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2df3f35c-e059-4045-94db-585d85ebb564 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:28.609643 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5a22589f-e8cc-4fc2-a947-753b27c49491 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 23221 microversion: 2.1 time: 0.113375 Sep 24 03:32:28.610380 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 95/180] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:28 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 23221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:32:28.665447 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2df3f35c-e059-4045-94db-585d85ebb564 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 14 microversion: 2.20 time: 0.116881 Sep 24 03:32:28.666243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 86/181] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:28 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:28.926727 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-44852648-f666-4b99-b5ef-39a46042e08c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:28.927600 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-44852648-f666-4b99-b5ef-39a46042e08c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:28.934063 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-44852648-f666-4b99-b5ef-39a46042e08c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:28.934507 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-44852648-f666-4b99-b5ef-39a46042e08c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:28.935268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-44852648-f666-4b99-b5ef-39a46042e08c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:28.935697 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-44852648-f666-4b99-b5ef-39a46042e08c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:29.007175 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-73152c01-1c79-4526-a638-26e0279883d5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:29.007854 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-73152c01-1c79-4526-a638-26e0279883d5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:29.014262 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-73152c01-1c79-4526-a638-26e0279883d5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:29.015354 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-73152c01-1c79-4526-a638-26e0279883d5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:29.016118 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-73152c01-1c79-4526-a638-26e0279883d5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:29.016537 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-73152c01-1c79-4526-a638-26e0279883d5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:29.056774 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-44852648-f666-4b99-b5ef-39a46042e08c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:29.064654 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-44852648-f666-4b99-b5ef-39a46042e08c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.141965 Sep 24 03:32:29.065231 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 96/182] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:28 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:29.165386 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-73152c01-1c79-4526-a638-26e0279883d5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:29.176501 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-73152c01-1c79-4526-a638-26e0279883d5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 200 len: 1318 microversion: 2.1 time: 0.173013 Sep 24 03:32:29.178139 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 87/183] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:29 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:29.621287 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-500f8a13-5e78-44a2-8d1c-e33cc2769c44 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:29.622249 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-500f8a13-5e78-44a2-8d1c-e33cc2769c44 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:29.629327 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-500f8a13-5e78-44a2-8d1c-e33cc2769c44 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:29.629809 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-500f8a13-5e78-44a2-8d1c-e33cc2769c44 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:29.630575 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-500f8a13-5e78-44a2-8d1c-e33cc2769c44 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:29.631002 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-500f8a13-5e78-44a2-8d1c-e33cc2769c44 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:29.677055 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b7852a48-2232-421b-a237-2baebe3b8498 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:29.678198 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b7852a48-2232-421b-a237-2baebe3b8498 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:29.683935 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b7852a48-2232-421b-a237-2baebe3b8498 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:29.684382 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b7852a48-2232-421b-a237-2baebe3b8498 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:29.685143 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b7852a48-2232-421b-a237-2baebe3b8498 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:29.685568 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b7852a48-2232-421b-a237-2baebe3b8498 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:33.119084 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-500f8a13-5e78-44a2-8d1c-e33cc2769c44 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 24626 microversion: 2.1 time: 3.501180 Sep 24 03:32:33.119725 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 97/184] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:29 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 24626 bytes in 3503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:32:33.124457 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-09471f32-a756-4be3-9744-77b28c999b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:33.125789 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-09471f32-a756-4be3-9744-77b28c999b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:33.132125 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-09471f32-a756-4be3-9744-77b28c999b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:33.132564 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-09471f32-a756-4be3-9744-77b28c999b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:33.133324 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-09471f32-a756-4be3-9744-77b28c999b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:33.133781 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-09471f32-a756-4be3-9744-77b28c999b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:33.180782 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b7852a48-2232-421b-a237-2baebe3b8498 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 12613 microversion: 2.20 time: 3.507074 Sep 24 03:32:33.181329 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 88/185] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:29 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 12613 bytes in 3509 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:32:33.186624 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-536cafac-324d-4767-9b73-5400917ce67c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:33.187314 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-536cafac-324d-4767-9b73-5400917ce67c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:33.194277 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-536cafac-324d-4767-9b73-5400917ce67c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:33.194724 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-536cafac-324d-4767-9b73-5400917ce67c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:33.195487 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-536cafac-324d-4767-9b73-5400917ce67c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:33.195920 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-536cafac-324d-4767-9b73-5400917ce67c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:33.283380 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-09471f32-a756-4be3-9744-77b28c999b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:33.290730 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-09471f32-a756-4be3-9744-77b28c999b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.169894 Sep 24 03:32:33.291321 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 98/186] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:33 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:33.344619 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-536cafac-324d-4767-9b73-5400917ce67c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:33.351857 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-536cafac-324d-4767-9b73-5400917ce67c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 200 len: 1318 microversion: 2.1 time: 0.169411 Sep 24 03:32:33.352412 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 89/187] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:33 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:34.130115 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e2effc58-d216-4fd7-b96c-95d84d5915bd tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:34.131037 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e2effc58-d216-4fd7-b96c-95d84d5915bd tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:34.137188 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e2effc58-d216-4fd7-b96c-95d84d5915bd tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:34.137632 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e2effc58-d216-4fd7-b96c-95d84d5915bd tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:34.138427 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e2effc58-d216-4fd7-b96c-95d84d5915bd tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:34.138856 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e2effc58-d216-4fd7-b96c-95d84d5915bd tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:34.192893 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-632708f5-413a-4a3b-ba01-f907d34ccfd0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:34.193988 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-632708f5-413a-4a3b-ba01-f907d34ccfd0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:34.200457 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-632708f5-413a-4a3b-ba01-f907d34ccfd0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:34.200966 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-632708f5-413a-4a3b-ba01-f907d34ccfd0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:34.201838 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-632708f5-413a-4a3b-ba01-f907d34ccfd0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:34.202326 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-632708f5-413a-4a3b-ba01-f907d34ccfd0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:37.533668 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e2effc58-d216-4fd7-b96c-95d84d5915bd tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 26659 microversion: 2.1 time: 3.406971 Sep 24 03:32:37.534344 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 99/188] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:34 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 26659 bytes in 3409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:32:37.539173 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0afeb0a2-9477-4fd9-96c6-7787a57cd80d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:37.539873 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0afeb0a2-9477-4fd9-96c6-7787a57cd80d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:37.546179 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0afeb0a2-9477-4fd9-96c6-7787a57cd80d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:37.546620 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0afeb0a2-9477-4fd9-96c6-7787a57cd80d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:37.548137 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0afeb0a2-9477-4fd9-96c6-7787a57cd80d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:37.548476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0afeb0a2-9477-4fd9-96c6-7787a57cd80d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:37.594426 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-632708f5-413a-4a3b-ba01-f907d34ccfd0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 17602 microversion: 2.20 time: 3.404570 Sep 24 03:32:37.595492 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 90/189] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:34 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 17602 bytes in 3408 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:32:37.600295 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-cdb2c871-e061-4bc7-bfd3-ae9014c3692c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:37.600977 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-cdb2c871-e061-4bc7-bfd3-ae9014c3692c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:37.607324 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cdb2c871-e061-4bc7-bfd3-ae9014c3692c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:37.607757 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cdb2c871-e061-4bc7-bfd3-ae9014c3692c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:37.608511 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cdb2c871-e061-4bc7-bfd3-ae9014c3692c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:37.608932 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cdb2c871-e061-4bc7-bfd3-ae9014c3692c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:37.691916 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0afeb0a2-9477-4fd9-96c6-7787a57cd80d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:37.699078 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0afeb0a2-9477-4fd9-96c6-7787a57cd80d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.163483 Sep 24 03:32:37.699636 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 100/190] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:37 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:37.704752 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-0048d594-d3e5-4de8-8ca1-5f72eb6dcd3c req-7b2f92bc-4652-421d-88a9-ded727edd02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e82aa7-3e22-4ec6-84e7-6042f04eb89f", "name": "network-vif-plugged", "status": "completed", "tag": "ea6cc573-5c51-43c0-abd7-1bce694ffedf"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:37.706280 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:32:37.706280 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:32:37.712929 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-0048d594-d3e5-4de8-8ca1-5f72eb6dcd3c req-7b2f92bc-4652-421d-88a9-ded727edd02f service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:37.713355 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-0048d594-d3e5-4de8-8ca1-5f72eb6dcd3c req-7b2f92bc-4652-421d-88a9-ded727edd02f service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:37.724672 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-0048d594-d3e5-4de8-8ca1-5f72eb6dcd3c req-7b2f92bc-4652-421d-88a9-ded727edd02f service nova] Creating event network-vif-plugged:ea6cc573-5c51-43c0-abd7-1bce694ffedf for instance 53e82aa7-3e22-4ec6-84e7-6042f04eb89f on hv-cinder-81080 Sep 24 03:32:37.729384 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-0048d594-d3e5-4de8-8ca1-5f72eb6dcd3c req-7b2f92bc-4652-421d-88a9-ded727edd02f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028619 Sep 24 03:32:37.730000 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 101/191] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:32:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:32:37.748147 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-cdb2c871-e061-4bc7-bfd3-ae9014c3692c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:37.755417 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-cdb2c871-e061-4bc7-bfd3-ae9014c3692c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 200 len: 1318 microversion: 2.1 time: 0.158732 Sep 24 03:32:37.755985 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 91/192] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:37 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:38.545997 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b40873c4-6376-4401-a5df-247e947b2898 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:38.547590 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b40873c4-6376-4401-a5df-247e947b2898 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:38.553555 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b40873c4-6376-4401-a5df-247e947b2898 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:38.554022 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b40873c4-6376-4401-a5df-247e947b2898 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:38.554770 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b40873c4-6376-4401-a5df-247e947b2898 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:38.555190 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b40873c4-6376-4401-a5df-247e947b2898 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:38.604923 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2e875d9f-3a65-4acd-a16e-bec510121b4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:38.605889 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2e875d9f-3a65-4acd-a16e-bec510121b4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:38.613102 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2e875d9f-3a65-4acd-a16e-bec510121b4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:38.613542 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2e875d9f-3a65-4acd-a16e-bec510121b4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:38.614332 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2e875d9f-3a65-4acd-a16e-bec510121b4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:38.614758 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2e875d9f-3a65-4acd-a16e-bec510121b4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:38.646813 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b40873c4-6376-4401-a5df-247e947b2898 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 27595 microversion: 2.1 time: 0.105052 Sep 24 03:32:38.647631 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 102/193] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:38 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 27595 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:32:38.703872 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2e875d9f-3a65-4acd-a16e-bec510121b4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 19034 microversion: 2.20 time: 0.102299 Sep 24 03:32:38.704494 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 92/194] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:38 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 19034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:32:38.716182 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b16f630c-74f5-4a6d-abca-48c4da91999d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:38.716870 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b16f630c-74f5-4a6d-abca-48c4da91999d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:38.724099 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b16f630c-74f5-4a6d-abca-48c4da91999d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:38.724542 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b16f630c-74f5-4a6d-abca-48c4da91999d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:38.725308 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b16f630c-74f5-4a6d-abca-48c4da91999d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:38.725750 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b16f630c-74f5-4a6d-abca-48c4da91999d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:38.773014 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d9fa7f88-edb0-45b7-bfd2-72affb31b604 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:38.773844 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d9fa7f88-edb0-45b7-bfd2-72affb31b604 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:38.780260 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d9fa7f88-edb0-45b7-bfd2-72affb31b604 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:38.780703 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d9fa7f88-edb0-45b7-bfd2-72affb31b604 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:38.782451 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d9fa7f88-edb0-45b7-bfd2-72affb31b604 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:38.782890 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d9fa7f88-edb0-45b7-bfd2-72affb31b604 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:38.874058 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b16f630c-74f5-4a6d-abca-48c4da91999d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:38.881435 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b16f630c-74f5-4a6d-abca-48c4da91999d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.169094 Sep 24 03:32:38.882035 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 103/195] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:38 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:38.928546 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d9fa7f88-edb0-45b7-bfd2-72affb31b604 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:38.935744 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d9fa7f88-edb0-45b7-bfd2-72affb31b604 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 200 len: 1318 microversion: 2.1 time: 0.166825 Sep 24 03:32:38.936397 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 93/196] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:38 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:39.659232 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3a9011e1-ea8a-4960-be56-26d1f74e4dba tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:39.660210 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3a9011e1-ea8a-4960-be56-26d1f74e4dba tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:39.666196 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3a9011e1-ea8a-4960-be56-26d1f74e4dba tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:39.666638 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3a9011e1-ea8a-4960-be56-26d1f74e4dba tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:39.667405 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3a9011e1-ea8a-4960-be56-26d1f74e4dba tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:39.667837 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3a9011e1-ea8a-4960-be56-26d1f74e4dba tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:39.714199 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-65f9fd69-74f4-4dbc-907c-20d0c3aacc8b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:39.715132 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-65f9fd69-74f4-4dbc-907c-20d0c3aacc8b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:39.721431 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-65f9fd69-74f4-4dbc-907c-20d0c3aacc8b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:39.721901 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-65f9fd69-74f4-4dbc-907c-20d0c3aacc8b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:39.722658 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-65f9fd69-74f4-4dbc-907c-20d0c3aacc8b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:39.723083 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-65f9fd69-74f4-4dbc-907c-20d0c3aacc8b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:39.786090 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3a9011e1-ea8a-4960-be56-26d1f74e4dba tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 27999 microversion: 2.1 time: 0.130843 Sep 24 03:32:39.786733 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 104/197] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:39 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 27999 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:32:39.814485 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-65f9fd69-74f4-4dbc-907c-20d0c3aacc8b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 20192 microversion: 2.20 time: 0.103720 Sep 24 03:32:39.815127 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 94/198] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:39 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 20192 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:32:39.898592 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f692e9e0-51f7-46de-81a7-4f1755bd8c89 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:39.899282 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f692e9e0-51f7-46de-81a7-4f1755bd8c89 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:39.905839 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f692e9e0-51f7-46de-81a7-4f1755bd8c89 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:39.906925 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f692e9e0-51f7-46de-81a7-4f1755bd8c89 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:39.907805 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f692e9e0-51f7-46de-81a7-4f1755bd8c89 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:39.908237 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f692e9e0-51f7-46de-81a7-4f1755bd8c89 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:39.953753 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8428c3b2-29f7-4117-bac6-92c5df1ae428 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:39.954572 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8428c3b2-29f7-4117-bac6-92c5df1ae428 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:39.960918 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8428c3b2-29f7-4117-bac6-92c5df1ae428 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:39.961349 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8428c3b2-29f7-4117-bac6-92c5df1ae428 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:39.962135 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8428c3b2-29f7-4117-bac6-92c5df1ae428 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:39.962554 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8428c3b2-29f7-4117-bac6-92c5df1ae428 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:40.058819 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-f692e9e0-51f7-46de-81a7-4f1755bd8c89 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:40.066222 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f692e9e0-51f7-46de-81a7-4f1755bd8c89 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.171883 Sep 24 03:32:40.067035 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 105/199] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:39 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:40.106759 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8428c3b2-29f7-4117-bac6-92c5df1ae428 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:40.114345 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8428c3b2-29f7-4117-bac6-92c5df1ae428 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 200 len: 1507 microversion: 2.1 time: 0.165603 Sep 24 03:32:40.115168 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 95/200] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:39 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:40.130831 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9f80cf9e-0035-40c3-872c-2b2bfe9523d0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecf9c83e-d980-4810-815b-7d43489f677e"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:40.131893 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9f80cf9e-0035-40c3-872c-2b2bfe9523d0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:40.137742 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9f80cf9e-0035-40c3-872c-2b2bfe9523d0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:40.138114 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9f80cf9e-0035-40c3-872c-2b2bfe9523d0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:40.138859 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9f80cf9e-0035-40c3-872c-2b2bfe9523d0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:40.139334 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9f80cf9e-0035-40c3-872c-2b2bfe9523d0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:40.226506 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-9f80cf9e-0035-40c3-872c-2b2bfe9523d0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] HTTP exception thrown: Invalid volume: volume ecf9c83e-d980-4810-815b-7d43489f677e is already attached to instances: 92c68dca-6afe-4e74-9291-542e2d0529b4 Sep 24 03:32:40.227101 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9f80cf9e-0035-40c3-872c-2b2bfe9523d0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Returning 400 to user: Invalid volume: volume ecf9c83e-d980-4810-815b-7d43489f677e is already attached to instances: 92c68dca-6afe-4e74-9291-542e2d0529b4 {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:32:40.227937 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9f80cf9e-0035-40c3-872c-2b2bfe9523d0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "POST /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100930 Sep 24 03:32:40.228641 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 106/201] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:32:40 2021] POST /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 03:32:40.295645 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f5fa5d61-73fc-4a1c-b4ca-78f173f3bf17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:40.296159 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f5fa5d61-73fc-4a1c-b4ca-78f173f3bf17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:40.302055 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f5fa5d61-73fc-4a1c-b4ca-78f173f3bf17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:40.302916 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f5fa5d61-73fc-4a1c-b4ca-78f173f3bf17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:40.303234 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f5fa5d61-73fc-4a1c-b4ca-78f173f3bf17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:40.303655 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f5fa5d61-73fc-4a1c-b4ca-78f173f3bf17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:40.445589 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-f5fa5d61-73fc-4a1c-b4ca-78f173f3bf17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lazy-loading 'services' on Instance uuid 92c68dca-6afe-4e74-9291-542e2d0529b4 {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:32:40.554490 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f5fa5d61-73fc-4a1c-b4ca-78f173f3bf17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4/os-volume_attachments/ecf9c83e-d980-4810-815b-7d43489f677e" status: 202 len: 0 microversion: 2.1 time: 0.262354 Sep 24 03:32:40.555251 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 96/202] 10.222.0.18 () {58 vars in 1416 bytes} [Fri Sep 24 03:32:40 2021] DELETE /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4/os-volume_attachments/ecf9c83e-d980-4810-815b-7d43489f677e => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:32:40.564455 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f401caa9-64f6-4fa4-860e-cb761c8c7a1d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:40.565369 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f401caa9-64f6-4fa4-860e-cb761c8c7a1d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:40.571915 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f401caa9-64f6-4fa4-860e-cb761c8c7a1d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:40.572401 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f401caa9-64f6-4fa4-860e-cb761c8c7a1d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:40.573314 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f401caa9-64f6-4fa4-860e-cb761c8c7a1d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:40.573767 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f401caa9-64f6-4fa4-860e-cb761c8c7a1d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:40.604463 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f401caa9-64f6-4fa4-860e-cb761c8c7a1d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044807 Sep 24 03:32:40.605019 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 107/203] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:32:40 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:32:40.798187 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-51dca36f-82b4-41a6-99f3-ad05a93f10c6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:40.799246 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-51dca36f-82b4-41a6-99f3-ad05a93f10c6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:40.805199 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-51dca36f-82b4-41a6-99f3-ad05a93f10c6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:40.805646 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-51dca36f-82b4-41a6-99f3-ad05a93f10c6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:40.806435 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-51dca36f-82b4-41a6-99f3-ad05a93f10c6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:40.806862 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-51dca36f-82b4-41a6-99f3-ad05a93f10c6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:40.827820 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f50a89e1-9f8e-4acd-b441-655585b7b37e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:40.829858 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f50a89e1-9f8e-4acd-b441-655585b7b37e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:40.836571 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f50a89e1-9f8e-4acd-b441-655585b7b37e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:40.837311 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f50a89e1-9f8e-4acd-b441-655585b7b37e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:40.838378 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f50a89e1-9f8e-4acd-b441-655585b7b37e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:40.839116 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f50a89e1-9f8e-4acd-b441-655585b7b37e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:43.930454 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-51dca36f-82b4-41a6-99f3-ad05a93f10c6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 28544 microversion: 2.1 time: 3.136125 Sep 24 03:32:43.933762 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 97/204] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:40 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 28544 bytes in 3138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:32:43.936198 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9f732be5-ede4-46ec-80bb-af73f3ef117a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:43.936897 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9f732be5-ede4-46ec-80bb-af73f3ef117a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:43.943487 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9f732be5-ede4-46ec-80bb-af73f3ef117a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:43.943990 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9f732be5-ede4-46ec-80bb-af73f3ef117a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:43.944756 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9f732be5-ede4-46ec-80bb-af73f3ef117a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:43.945185 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9f732be5-ede4-46ec-80bb-af73f3ef117a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:43.976680 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f50a89e1-9f8e-4acd-b441-655585b7b37e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 25327 microversion: 2.20 time: 3.152326 Sep 24 03:32:43.980646 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 108/205] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:40 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 25327 bytes in 3154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:32:43.982595 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-90429a72-e8f8-4ab1-b728-623b9b1bd6e6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:43.983564 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-90429a72-e8f8-4ab1-b728-623b9b1bd6e6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:43.990401 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-90429a72-e8f8-4ab1-b728-623b9b1bd6e6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:43.990831 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-90429a72-e8f8-4ab1-b728-623b9b1bd6e6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:43.991743 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-90429a72-e8f8-4ab1-b728-623b9b1bd6e6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:43.992164 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-90429a72-e8f8-4ab1-b728-623b9b1bd6e6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:44.022880 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-90429a72-e8f8-4ab1-b728-623b9b1bd6e6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044244 Sep 24 03:32:44.023447 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 109/206] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:32:43 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:32:44.065152 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9f732be5-ede4-46ec-80bb-af73f3ef117a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:44.072337 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9f732be5-ede4-46ec-80bb-af73f3ef117a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.140060 Sep 24 03:32:44.072901 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 98/207] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:43 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:44.736524 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1486539212", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:44.789505 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.network.neutron [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] validate_networks() for None {{(pid=109374) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:32:44.943394 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e4297b82-dbff-4431-9dfd-cbe2e7fcd39f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:44.944500 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e4297b82-dbff-4431-9dfd-cbe2e7fcd39f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:44.951325 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e4297b82-dbff-4431-9dfd-cbe2e7fcd39f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:44.951853 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e4297b82-dbff-4431-9dfd-cbe2e7fcd39f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:44.952698 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e4297b82-dbff-4431-9dfd-cbe2e7fcd39f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:44.953200 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e4297b82-dbff-4431-9dfd-cbe2e7fcd39f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:45.037787 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e4297b82-dbff-4431-9dfd-cbe2e7fcd39f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 28544 microversion: 2.1 time: 0.099082 Sep 24 03:32:45.038781 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 99/208] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:44 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 28544 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:32:45.043385 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9c9bb1a9-a232-429b-9f41-2da0aae6bc50 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:45.044347 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9c9bb1a9-a232-429b-9f41-2da0aae6bc50 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:45.051842 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c9bb1a9-a232-429b-9f41-2da0aae6bc50 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:45.052277 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c9bb1a9-a232-429b-9f41-2da0aae6bc50 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:45.053037 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c9bb1a9-a232-429b-9f41-2da0aae6bc50 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:45.053462 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c9bb1a9-a232-429b-9f41-2da0aae6bc50 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:45.089554 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Flavor limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:32:45.090051 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Image limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:32:45.090480 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Flavor pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:32:45.090880 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Image pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:32:45.091285 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:32:45.099967 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:45.100408 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:45.101201 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:45.101625 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:45.118149 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Getting quotas for project e11f8519cf314421b5dffddf43fff375. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:32:45.121958 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Getting quotas for user e4b3bbfc64c346eba2b16ede0d45a1ff and project e11f8519cf314421b5dffddf43fff375. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:32:45.132845 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Going to run 1 instances... {{(pid=109374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:32:45.135149 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:32:45.146944 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9c9bb1a9-a232-429b-9f41-2da0aae6bc50 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 26078 microversion: 2.20 time: 0.107026 Sep 24 03:32:45.147817 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 100/209] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:45 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 26078 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:32:45.152905 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-213645f9-4fa4-4efe-a37d-777757df4041 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:45.153922 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-213645f9-4fa4-4efe-a37d-777757df4041 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:45.160483 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-213645f9-4fa4-4efe-a37d-777757df4041 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:45.160931 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-213645f9-4fa4-4efe-a37d-777757df4041 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:45.162085 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-213645f9-4fa4-4efe-a37d-777757df4041 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:45.162362 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-213645f9-4fa4-4efe-a37d-777757df4041 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:45.184551 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e0880b65-6662-4148-b6a6-4c46033c7d53 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.452104 Sep 24 03:32:45.190924 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 110/210] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:32:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:32:45.190924 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-73ef8eef-bdf8-4438-8957-5b9a9608392b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:45.191620 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-73ef8eef-bdf8-4438-8957-5b9a9608392b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:45.200793 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-73ef8eef-bdf8-4438-8957-5b9a9608392b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:45.201264 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-73ef8eef-bdf8-4438-8957-5b9a9608392b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:45.202109 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-73ef8eef-bdf8-4438-8957-5b9a9608392b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:45.202573 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-73ef8eef-bdf8-4438-8957-5b9a9608392b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:45.203994 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-213645f9-4fa4-4efe-a37d-777757df4041 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054919 Sep 24 03:32:45.204716 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 101/211] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:32:45 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:32:45.209313 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-87644646-eba0-411a-a1fb-5eb0097b6d92 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:45.210399 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-87644646-eba0-411a-a1fb-5eb0097b6d92 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:45.278478 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-87644646-eba0-411a-a1fb-5eb0097b6d92 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:45.285972 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-87644646-eba0-411a-a1fb-5eb0097b6d92 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1215 microversion: 2.1 time: 0.079934 Sep 24 03:32:45.286989 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 102/212] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:45 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:45.382959 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-73ef8eef-bdf8-4438-8957-5b9a9608392b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:45.391488 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-73ef8eef-bdf8-4438-8957-5b9a9608392b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.204932 Sep 24 03:32:45.401448 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 111/213] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:45 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:45.411480 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-829916076", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "networks": [{"uuid": "da8a83a1-4718-4b4d-b03f-5ba6c433eea0"}]}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:45.467371 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.network.neutron [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] validate_networks() for [('da8a83a1-4718-4b4d-b03f-5ba6c433eea0', None, None, None, None, None)] {{(pid=109375) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:32:46.047363 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Flavor limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:32:46.048509 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Image limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:32:46.048998 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Flavor pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:32:46.049406 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Image pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:32:46.049840 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:32:46.050368 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-258f94cb-1c20-46a9-b5f4-5883dfd12d0c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:46.051342 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-258f94cb-1c20-46a9-b5f4-5883dfd12d0c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:46.057017 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-258f94cb-1c20-46a9-b5f4-5883dfd12d0c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:46.057633 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-258f94cb-1c20-46a9-b5f4-5883dfd12d0c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:46.058429 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-258f94cb-1c20-46a9-b5f4-5883dfd12d0c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:46.058548 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:46.058852 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-258f94cb-1c20-46a9-b5f4-5883dfd12d0c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:46.058992 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:46.059784 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:46.060212 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:46.077081 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Getting quotas for project cad76815db3c4a67adf42217edb51d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:32:46.081122 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Getting quotas for user 332a6e416a1347d8927b2d48cc37ac37 and project cad76815db3c4a67adf42217edb51d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:32:46.091926 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Going to run 1 instances... {{(pid=109375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:32:46.094288 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:32:46.137995 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-fbd57ad7-972b-47fb-baec-25f26c482e17 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730150 Sep 24 03:32:46.138455 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-258f94cb-1c20-46a9-b5f4-5883dfd12d0c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 28544 microversion: 2.1 time: 0.092431 Sep 24 03:32:46.138979 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 103/214] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:32:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:32:46.139411 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 112/215] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:46 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 28544 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:32:46.148544 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a9aec72d-6314-4a68-a13b-2601f5f7806e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:46.149199 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a9aec72d-6314-4a68-a13b-2601f5f7806e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:46.159446 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9220f109-1890-4dce-a9ef-914ae1e80ce0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:46.160714 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9220f109-1890-4dce-a9ef-914ae1e80ce0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:46.168042 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9220f109-1890-4dce-a9ef-914ae1e80ce0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:46.168556 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9220f109-1890-4dce-a9ef-914ae1e80ce0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:46.169486 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9220f109-1890-4dce-a9ef-914ae1e80ce0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:46.170020 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9220f109-1890-4dce-a9ef-914ae1e80ce0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:46.347871 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a9aec72d-6314-4a68-a13b-2601f5f7806e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:46.355456 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a9aec72d-6314-4a68-a13b-2601f5f7806e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1217 microversion: 2.1 time: 0.210493 Sep 24 03:32:46.356009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 104/216] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:46 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1217 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:46.368657 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b8f325c5-e719-4a23-8d51-c4f9d77e03f5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:46.369420 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b8f325c5-e719-4a23-8d51-c4f9d77e03f5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:46.375223 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b8f325c5-e719-4a23-8d51-c4f9d77e03f5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:46.376204 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b8f325c5-e719-4a23-8d51-c4f9d77e03f5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:46.376965 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b8f325c5-e719-4a23-8d51-c4f9d77e03f5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:46.377389 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b8f325c5-e719-4a23-8d51-c4f9d77e03f5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:46.438050 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b8f325c5-e719-4a23-8d51-c4f9d77e03f5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:46.445990 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b8f325c5-e719-4a23-8d51-c4f9d77e03f5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1275 microversion: 2.1 time: 0.083216 Sep 24 03:32:46.455767 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 105/217] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:46 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:46.455767 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-7e909747-661c-4d5a-b193-497b9b905409 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:46.455767 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-7e909747-661c-4d5a-b193-497b9b905409 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:46.462688 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7e909747-661c-4d5a-b193-497b9b905409 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:46.463124 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7e909747-661c-4d5a-b193-497b9b905409 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:46.463881 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7e909747-661c-4d5a-b193-497b9b905409 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:46.464336 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7e909747-661c-4d5a-b193-497b9b905409 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:46.589898 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-7e909747-661c-4d5a-b193-497b9b905409 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:46.597149 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-7e909747-661c-4d5a-b193-497b9b905409 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.149252 Sep 24 03:32:46.597725 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 106/218] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:46 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:47.150044 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e6daca01-aead-41e9-b73a-2b4bd7a79865 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:47.151009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e6daca01-aead-41e9-b73a-2b4bd7a79865 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:47.156744 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e6daca01-aead-41e9-b73a-2b4bd7a79865 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:47.157318 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e6daca01-aead-41e9-b73a-2b4bd7a79865 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:47.158098 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e6daca01-aead-41e9-b73a-2b4bd7a79865 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:47.158542 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e6daca01-aead-41e9-b73a-2b4bd7a79865 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:49.222163 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9220f109-1890-4dce-a9ef-914ae1e80ce0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 27534 microversion: 2.20 time: 3.067340 Sep 24 03:32:49.222808 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 113/219] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:46 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 27534 bytes in 3069 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:32:49.227758 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b8bc2c81-ea22-4f0c-ab0c-45c28b7bd2a1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:49.228447 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b8bc2c81-ea22-4f0c-ab0c-45c28b7bd2a1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:49.235762 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b8bc2c81-ea22-4f0c-ab0c-45c28b7bd2a1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:49.236250 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b8bc2c81-ea22-4f0c-ab0c-45c28b7bd2a1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:49.237090 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b8bc2c81-ea22-4f0c-ab0c-45c28b7bd2a1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:49.237602 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b8bc2c81-ea22-4f0c-ab0c-45c28b7bd2a1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:49.297259 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e6daca01-aead-41e9-b73a-2b4bd7a79865 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 28544 microversion: 2.1 time: 2.150577 Sep 24 03:32:49.299104 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 107/220] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:47 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 28544 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:32:49.304193 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c11e735d-d90a-427e-9843-1e569a233a95 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:49.304927 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c11e735d-d90a-427e-9843-1e569a233a95 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:49.321616 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c11e735d-d90a-427e-9843-1e569a233a95 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:49.322094 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c11e735d-d90a-427e-9843-1e569a233a95 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:49.322870 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c11e735d-d90a-427e-9843-1e569a233a95 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:49.323301 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c11e735d-d90a-427e-9843-1e569a233a95 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:49.395893 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b8bc2c81-ea22-4f0c-ab0c-45c28b7bd2a1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:49.403689 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b8bc2c81-ea22-4f0c-ab0c-45c28b7bd2a1 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1221 microversion: 2.1 time: 0.179622 Sep 24 03:32:49.405348 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 114/221] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:49 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1221 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:49.409937 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-fcc66673-ccaa-43e8-8f42-c9930819b970 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:49.410557 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-fcc66673-ccaa-43e8-8f42-c9930819b970 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:49.416467 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fcc66673-ccaa-43e8-8f42-c9930819b970 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:49.416911 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fcc66673-ccaa-43e8-8f42-c9930819b970 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:49.417905 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fcc66673-ccaa-43e8-8f42-c9930819b970 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:49.418501 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fcc66673-ccaa-43e8-8f42-c9930819b970 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:49.468526 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c11e735d-d90a-427e-9843-1e569a233a95 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:49.482865 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c11e735d-d90a-427e-9843-1e569a233a95 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1285 microversion: 2.1 time: 0.182335 Sep 24 03:32:49.483620 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 108/222] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:49 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:49.645324 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-fcc66673-ccaa-43e8-8f42-c9930819b970 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:49.654356 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-fcc66673-ccaa-43e8-8f42-c9930819b970 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.248841 Sep 24 03:32:49.654923 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 115/223] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:49 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:50.248686 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-0b65ad91-5f28-4013-9dbf-4f4393d0ad9f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:50.248686 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-0b65ad91-5f28-4013-9dbf-4f4393d0ad9f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:50.255297 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0b65ad91-5f28-4013-9dbf-4f4393d0ad9f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:50.255855 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0b65ad91-5f28-4013-9dbf-4f4393d0ad9f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:50.256775 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0b65ad91-5f28-4013-9dbf-4f4393d0ad9f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:50.257355 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0b65ad91-5f28-4013-9dbf-4f4393d0ad9f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:50.311259 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-01affefa-39b4-4774-86d9-9a64c9527771 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:50.313885 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-01affefa-39b4-4774-86d9-9a64c9527771 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:50.321105 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-01affefa-39b4-4774-86d9-9a64c9527771 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:50.321863 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-01affefa-39b4-4774-86d9-9a64c9527771 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:50.323040 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-01affefa-39b4-4774-86d9-9a64c9527771 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:50.323687 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-01affefa-39b4-4774-86d9-9a64c9527771 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:50.361209 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-0b65ad91-5f28-4013-9dbf-4f4393d0ad9f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 27744 microversion: 2.20 time: 0.130602 Sep 24 03:32:50.365576 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 109/224] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:50 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 27744 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:32:50.424777 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-01affefa-39b4-4774-86d9-9a64c9527771 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 28544 microversion: 2.1 time: 0.117376 Sep 24 03:32:50.426328 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 116/225] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:50 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 28544 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:32:50.427510 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d43743f7-bc19-4592-8a48-dda803578eb6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:50.428669 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d43743f7-bc19-4592-8a48-dda803578eb6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:50.435039 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d43743f7-bc19-4592-8a48-dda803578eb6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:50.435480 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d43743f7-bc19-4592-8a48-dda803578eb6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:50.436277 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d43743f7-bc19-4592-8a48-dda803578eb6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:50.436701 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d43743f7-bc19-4592-8a48-dda803578eb6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:50.500970 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-00ef835c-b1ae-4fd9-be1f-ab49c5491631 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:50.501703 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-00ef835c-b1ae-4fd9-be1f-ab49c5491631 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:50.512516 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d43743f7-bc19-4592-8a48-dda803578eb6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:50.518043 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-00ef835c-b1ae-4fd9-be1f-ab49c5491631 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:50.518747 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-00ef835c-b1ae-4fd9-be1f-ab49c5491631 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:50.519691 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-00ef835c-b1ae-4fd9-be1f-ab49c5491631 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:50.520115 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-00ef835c-b1ae-4fd9-be1f-ab49c5491631 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:50.529682 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d43743f7-bc19-4592-8a48-dda803578eb6 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1275 microversion: 2.1 time: 0.110189 Sep 24 03:32:50.540921 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 110/226] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:50 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1275 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:50.671727 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1525c695-fc7e-4c29-93fe-56bd63985ef1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:50.672655 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1525c695-fc7e-4c29-93fe-56bd63985ef1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:50.678604 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1525c695-fc7e-4c29-93fe-56bd63985ef1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:50.679142 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1525c695-fc7e-4c29-93fe-56bd63985ef1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:50.679795 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1525c695-fc7e-4c29-93fe-56bd63985ef1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:50.680219 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1525c695-fc7e-4c29-93fe-56bd63985ef1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:50.738860 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-00ef835c-b1ae-4fd9-be1f-ab49c5491631 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:50.746886 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-00ef835c-b1ae-4fd9-be1f-ab49c5491631 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1315 microversion: 2.1 time: 0.249972 Sep 24 03:32:50.748136 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 117/227] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:50 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:50.931593 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1525c695-fc7e-4c29-93fe-56bd63985ef1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:50.941071 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1525c695-fc7e-4c29-93fe-56bd63985ef1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.273150 Sep 24 03:32:50.954469 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 111/228] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:50 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:51.088931 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-247a52de-37a6-4eb4-9ade-f82d1b0bea2f req-37035acd-89e9-4db6-8b40-b64e99b3c2ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1b5536-1ee4-4d4a-bafa-1c4dd0369704", "tag": "1744bf94-58fc-4c5d-9551-1fa3f491967c"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:51.091078 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:32:51.091078 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:32:51.100711 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-247a52de-37a6-4eb4-9ade-f82d1b0bea2f req-37035acd-89e9-4db6-8b40-b64e99b3c2ea service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:51.101298 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-247a52de-37a6-4eb4-9ade-f82d1b0bea2f req-37035acd-89e9-4db6-8b40-b64e99b3c2ea service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:51.118794 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-247a52de-37a6-4eb4-9ade-f82d1b0bea2f req-37035acd-89e9-4db6-8b40-b64e99b3c2ea service nova] Creating event network-changed:1744bf94-58fc-4c5d-9551-1fa3f491967c for instance 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 on hv-cinder-81080 Sep 24 03:32:51.123410 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-247a52de-37a6-4eb4-9ade-f82d1b0bea2f req-37035acd-89e9-4db6-8b40-b64e99b3c2ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038176 Sep 24 03:32:51.123957 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 118/229] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:32:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:32:51.372273 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-93bcf065-6107-44d1-91a6-4946302c0e02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:51.373109 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-93bcf065-6107-44d1-91a6-4946302c0e02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:51.383583 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-93bcf065-6107-44d1-91a6-4946302c0e02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:51.383953 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-93bcf065-6107-44d1-91a6-4946302c0e02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:51.384728 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-93bcf065-6107-44d1-91a6-4946302c0e02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:51.385150 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-93bcf065-6107-44d1-91a6-4946302c0e02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:51.443239 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-33ad43aa-f00a-416f-a24b-8e4a50713d8f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:51.444900 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-33ad43aa-f00a-416f-a24b-8e4a50713d8f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:51.455506 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-33ad43aa-f00a-416f-a24b-8e4a50713d8f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:51.455961 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-33ad43aa-f00a-416f-a24b-8e4a50713d8f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:51.457882 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-33ad43aa-f00a-416f-a24b-8e4a50713d8f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:51.458325 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-33ad43aa-f00a-416f-a24b-8e4a50713d8f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:51.509094 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-93bcf065-6107-44d1-91a6-4946302c0e02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28120 microversion: 2.20 time: 0.140307 Sep 24 03:32:51.510192 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 112/230] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:51 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28120 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:32:51.548477 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-06731777-d9f8-4183-882f-f48339fb6bce tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:51.549181 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-06731777-d9f8-4183-882f-f48339fb6bce tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:51.555678 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-06731777-d9f8-4183-882f-f48339fb6bce tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:51.556304 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-06731777-d9f8-4183-882f-f48339fb6bce tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:51.557663 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-06731777-d9f8-4183-882f-f48339fb6bce tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:51.558512 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-06731777-d9f8-4183-882f-f48339fb6bce tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:51.594014 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-33ad43aa-f00a-416f-a24b-8e4a50713d8f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 28831 microversion: 2.1 time: 0.160412 Sep 24 03:32:51.595636 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 119/231] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:51 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 28831 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:32:51.608811 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-42409392-b2c7-41a6-a173-8209806896ac req-a0cfb496-0f35-45a9-b937-6c89ee9b79e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e63e97-71b1-48b6-af18-ea2f33d55dd3", "tag": "560c4fee-dbda-4b10-966d-3589544f945a"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:51.611022 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:32:51.611022 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:32:51.622787 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-42409392-b2c7-41a6-a173-8209806896ac req-a0cfb496-0f35-45a9-b937-6c89ee9b79e7 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:51.623307 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-42409392-b2c7-41a6-a173-8209806896ac req-a0cfb496-0f35-45a9-b937-6c89ee9b79e7 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:51.634956 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-42409392-b2c7-41a6-a173-8209806896ac req-a0cfb496-0f35-45a9-b937-6c89ee9b79e7 service nova] Creating event network-changed:560c4fee-dbda-4b10-966d-3589544f945a for instance d7e63e97-71b1-48b6-af18-ea2f33d55dd3 on hv-cinder-81080 Sep 24 03:32:51.639586 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-42409392-b2c7-41a6-a173-8209806896ac req-a0cfb496-0f35-45a9-b937-6c89ee9b79e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042266 Sep 24 03:32:51.640182 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 120/232] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:32:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:32:51.751825 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-06731777-d9f8-4183-882f-f48339fb6bce tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:51.760432 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-06731777-d9f8-4183-882f-f48339fb6bce tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1317 microversion: 2.1 time: 0.217373 Sep 24 03:32:51.761327 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 113/233] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:51 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:51.764858 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6cc95c10-74ed-4986-8202-96ebbd9ca4bf tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:51.765784 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6cc95c10-74ed-4986-8202-96ebbd9ca4bf tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:51.772379 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6cc95c10-74ed-4986-8202-96ebbd9ca4bf tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:51.772831 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6cc95c10-74ed-4986-8202-96ebbd9ca4bf tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:51.773607 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6cc95c10-74ed-4986-8202-96ebbd9ca4bf tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:51.774070 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6cc95c10-74ed-4986-8202-96ebbd9ca4bf tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:51.954387 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6cc95c10-74ed-4986-8202-96ebbd9ca4bf tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:51.959663 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3420baa6-e40b-474f-9f7b-ffb0ac366214 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:51.960275 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3420baa6-e40b-474f-9f7b-ffb0ac366214 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:51.961653 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6cc95c10-74ed-4986-8202-96ebbd9ca4bf tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1315 microversion: 2.1 time: 0.201055 Sep 24 03:32:51.962415 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 121/234] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:51 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:51.966252 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3420baa6-e40b-474f-9f7b-ffb0ac366214 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:51.966763 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3420baa6-e40b-474f-9f7b-ffb0ac366214 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:51.967535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3420baa6-e40b-474f-9f7b-ffb0ac366214 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:51.967964 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3420baa6-e40b-474f-9f7b-ffb0ac366214 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:52.086183 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-3420baa6-e40b-474f-9f7b-ffb0ac366214 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:52.093336 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3420baa6-e40b-474f-9f7b-ffb0ac366214 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.137316 Sep 24 03:32:52.093920 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 114/235] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:51 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:52.521223 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6ab22fb5-0bcc-40cb-bb98-165bf2e8bbf5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:52.522152 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6ab22fb5-0bcc-40cb-bb98-165bf2e8bbf5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:52.528061 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6ab22fb5-0bcc-40cb-bb98-165bf2e8bbf5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:52.528498 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6ab22fb5-0bcc-40cb-bb98-165bf2e8bbf5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:52.529252 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6ab22fb5-0bcc-40cb-bb98-165bf2e8bbf5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:52.529674 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6ab22fb5-0bcc-40cb-bb98-165bf2e8bbf5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:52.606322 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-85341288-12cf-4637-8d0d-5518ce8e96eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:52.607235 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-85341288-12cf-4637-8d0d-5518ce8e96eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:52.614467 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-85341288-12cf-4637-8d0d-5518ce8e96eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:52.615168 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-85341288-12cf-4637-8d0d-5518ce8e96eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:52.615929 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-85341288-12cf-4637-8d0d-5518ce8e96eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:52.616361 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-85341288-12cf-4637-8d0d-5518ce8e96eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:54.765670 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-85341288-12cf-4637-8d0d-5518ce8e96eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 28833 microversion: 2.1 time: 2.162740 Sep 24 03:32:54.769869 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 115/236] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:52 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 28833 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:32:54.772108 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3b959b30-aa4d-43b2-93b8-f9fceb3773d4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:54.772716 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3b959b30-aa4d-43b2-93b8-f9fceb3773d4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:54.779463 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3b959b30-aa4d-43b2-93b8-f9fceb3773d4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:54.780031 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3b959b30-aa4d-43b2-93b8-f9fceb3773d4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:54.780928 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3b959b30-aa4d-43b2-93b8-f9fceb3773d4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:54.781360 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3b959b30-aa4d-43b2-93b8-f9fceb3773d4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:54.783137 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6ab22fb5-0bcc-40cb-bb98-165bf2e8bbf5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28180 microversion: 2.20 time: 2.265475 Sep 24 03:32:54.784897 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 122/237] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:52 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28180 bytes in 2268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:32:54.789251 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c965c7ce-3e6c-45c1-bbf3-b4b5b62c1ff1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:54.789962 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c965c7ce-3e6c-45c1-bbf3-b4b5b62c1ff1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:54.802948 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c965c7ce-3e6c-45c1-bbf3-b4b5b62c1ff1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:54.803408 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c965c7ce-3e6c-45c1-bbf3-b4b5b62c1ff1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:54.804374 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c965c7ce-3e6c-45c1-bbf3-b4b5b62c1ff1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:54.804810 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c965c7ce-3e6c-45c1-bbf3-b4b5b62c1ff1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:55.056746 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-3b959b30-aa4d-43b2-93b8-f9fceb3773d4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:55.064967 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3b959b30-aa4d-43b2-93b8-f9fceb3773d4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1317 microversion: 2.1 time: 0.297232 Sep 24 03:32:55.065776 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 116/238] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:54 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:55.075897 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c965c7ce-3e6c-45c1-bbf3-b4b5b62c1ff1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:55.079078 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b2966f25-f452-4f58-9291-bf8d44fe8bf9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:55.079685 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b2966f25-f452-4f58-9291-bf8d44fe8bf9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:55.084343 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c965c7ce-3e6c-45c1-bbf3-b4b5b62c1ff1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1315 microversion: 2.1 time: 0.298892 Sep 24 03:32:55.085260 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 123/239] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:54 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:55.087172 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b2966f25-f452-4f58-9291-bf8d44fe8bf9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:55.094588 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b2966f25-f452-4f58-9291-bf8d44fe8bf9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:55.095427 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b2966f25-f452-4f58-9291-bf8d44fe8bf9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:55.096115 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b2966f25-f452-4f58-9291-bf8d44fe8bf9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:55.245169 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b2966f25-f452-4f58-9291-bf8d44fe8bf9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:55.253893 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b2966f25-f452-4f58-9291-bf8d44fe8bf9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.178319 Sep 24 03:32:55.254480 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 117/240] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:55 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:55.776410 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4e88c34f-b0bd-4ebf-8747-782a8e93c563 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:55.777321 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4e88c34f-b0bd-4ebf-8747-782a8e93c563 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:55.783887 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4e88c34f-b0bd-4ebf-8747-782a8e93c563 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:55.784429 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4e88c34f-b0bd-4ebf-8747-782a8e93c563 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:55.785126 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4e88c34f-b0bd-4ebf-8747-782a8e93c563 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:55.785561 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4e88c34f-b0bd-4ebf-8747-782a8e93c563 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:55.795445 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-80a1e52b-0466-4739-9341-aa64bdd06c79 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:55.796521 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-80a1e52b-0466-4739-9341-aa64bdd06c79 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:55.803491 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-80a1e52b-0466-4739-9341-aa64bdd06c79 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:55.807060 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-80a1e52b-0466-4739-9341-aa64bdd06c79 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:55.807060 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-80a1e52b-0466-4739-9341-aa64bdd06c79 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:55.807060 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-80a1e52b-0466-4739-9341-aa64bdd06c79 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:55.871152 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4e88c34f-b0bd-4ebf-8747-782a8e93c563 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 28833 microversion: 2.1 time: 0.098088 Sep 24 03:32:55.871834 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 124/241] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:55 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 28833 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:32:55.901666 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-80a1e52b-0466-4739-9341-aa64bdd06c79 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28180 microversion: 2.20 time: 0.109966 Sep 24 03:32:55.902529 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 118/242] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:55 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28180 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:32:56.083184 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f75ab70c-c8ef-4fdd-9985-6bbf4502eb05 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:56.083832 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f75ab70c-c8ef-4fdd-9985-6bbf4502eb05 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:56.090192 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f75ab70c-c8ef-4fdd-9985-6bbf4502eb05 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:56.090635 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f75ab70c-c8ef-4fdd-9985-6bbf4502eb05 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:56.091391 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f75ab70c-c8ef-4fdd-9985-6bbf4502eb05 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:56.091820 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f75ab70c-c8ef-4fdd-9985-6bbf4502eb05 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:56.100435 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-696f122b-8985-4de9-bac1-17c9e46f46c5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:56.101260 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-696f122b-8985-4de9-bac1-17c9e46f46c5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:56.107667 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-696f122b-8985-4de9-bac1-17c9e46f46c5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:56.108114 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-696f122b-8985-4de9-bac1-17c9e46f46c5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:56.108882 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-696f122b-8985-4de9-bac1-17c9e46f46c5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:56.109310 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-696f122b-8985-4de9-bac1-17c9e46f46c5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:56.270144 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-f75ab70c-c8ef-4fdd-9985-6bbf4502eb05 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:56.277477 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f75ab70c-c8ef-4fdd-9985-6bbf4502eb05 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1317 microversion: 2.1 time: 0.198998 Sep 24 03:32:56.278073 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 125/243] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:56 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:56.282588 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e4938835-5024-48d3-9735-ec08d3a863a9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:56.282720 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-696f122b-8985-4de9-bac1-17c9e46f46c5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:56.283491 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e4938835-5024-48d3-9735-ec08d3a863a9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:56.289226 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e4938835-5024-48d3-9735-ec08d3a863a9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:56.289663 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e4938835-5024-48d3-9735-ec08d3a863a9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:56.290447 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e4938835-5024-48d3-9735-ec08d3a863a9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:56.290872 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e4938835-5024-48d3-9735-ec08d3a863a9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:56.292586 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-696f122b-8985-4de9-bac1-17c9e46f46c5 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1315 microversion: 2.1 time: 0.196078 Sep 24 03:32:56.293153 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 119/244] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:56 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:56.411853 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e4938835-5024-48d3-9735-ec08d3a863a9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:56.419222 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e4938835-5024-48d3-9735-ec08d3a863a9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.140189 Sep 24 03:32:56.419792 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 126/245] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:56 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:56.883158 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-136e7855-652b-4034-9bef-ea0d4aa90cbf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:56.884137 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-136e7855-652b-4034-9bef-ea0d4aa90cbf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:56.889885 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-136e7855-652b-4034-9bef-ea0d4aa90cbf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:56.890332 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-136e7855-652b-4034-9bef-ea0d4aa90cbf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:56.891091 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-136e7855-652b-4034-9bef-ea0d4aa90cbf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:56.891520 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-136e7855-652b-4034-9bef-ea0d4aa90cbf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:56.912500 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-989a37b2-154c-4e59-a59c-3c3181f822a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:56.913472 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-989a37b2-154c-4e59-a59c-3c3181f822a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:56.919269 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-989a37b2-154c-4e59-a59c-3c3181f822a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:56.919871 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-989a37b2-154c-4e59-a59c-3c3181f822a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:56.920826 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-989a37b2-154c-4e59-a59c-3c3181f822a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:56.921496 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-989a37b2-154c-4e59-a59c-3c3181f822a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:57.000554 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-136e7855-652b-4034-9bef-ea0d4aa90cbf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 29001 microversion: 2.1 time: 0.120574 Sep 24 03:32:57.002443 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 120/246] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:56 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 29001 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:32:57.004599 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-989a37b2-154c-4e59-a59c-3c3181f822a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28180 microversion: 2.20 time: 0.095504 Sep 24 03:32:57.005830 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 127/247] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:56 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28180 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:32:57.294784 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-76715048-9652-4a89-b02b-1f5bac1707e3 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:57.295474 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-76715048-9652-4a89-b02b-1f5bac1707e3 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:57.302466 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-76715048-9652-4a89-b02b-1f5bac1707e3 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:57.302911 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-76715048-9652-4a89-b02b-1f5bac1707e3 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:57.303668 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-76715048-9652-4a89-b02b-1f5bac1707e3 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:57.304095 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-76715048-9652-4a89-b02b-1f5bac1707e3 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:57.309906 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-fc4298eb-63c9-4771-9e7c-b46f6869fbd8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:57.310668 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-fc4298eb-63c9-4771-9e7c-b46f6869fbd8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:57.317763 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fc4298eb-63c9-4771-9e7c-b46f6869fbd8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:57.318202 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fc4298eb-63c9-4771-9e7c-b46f6869fbd8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:57.318959 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fc4298eb-63c9-4771-9e7c-b46f6869fbd8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:57.319378 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fc4298eb-63c9-4771-9e7c-b46f6869fbd8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:57.483661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-76715048-9652-4a89-b02b-1f5bac1707e3 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:57.491592 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-fc4298eb-63c9-4771-9e7c-b46f6869fbd8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:57.491833 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-76715048-9652-4a89-b02b-1f5bac1707e3 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1317 microversion: 2.1 time: 0.201262 Sep 24 03:32:57.492400 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 121/248] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:57 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:57.496572 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-506f4704-ba5d-452e-ac06-df7d2aa79721 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:57.497161 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-506f4704-ba5d-452e-ac06-df7d2aa79721 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:57.503203 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-fc4298eb-63c9-4771-9e7c-b46f6869fbd8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1315 microversion: 2.1 time: 0.197122 Sep 24 03:32:57.503792 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 128/249] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:57 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:57.503971 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-506f4704-ba5d-452e-ac06-df7d2aa79721 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:57.504277 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-506f4704-ba5d-452e-ac06-df7d2aa79721 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:57.505123 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-506f4704-ba5d-452e-ac06-df7d2aa79721 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:57.505562 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-506f4704-ba5d-452e-ac06-df7d2aa79721 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:57.623431 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-506f4704-ba5d-452e-ac06-df7d2aa79721 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:57.631243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-506f4704-ba5d-452e-ac06-df7d2aa79721 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.137918 Sep 24 03:32:57.631801 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 122/250] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:57 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:58.012376 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-43f2ad6e-7971-43ca-b29c-d9ee0386b053 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:58.013291 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-43f2ad6e-7971-43ca-b29c-d9ee0386b053 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:58.016084 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-425cb918-dcc0-4ebf-85fb-e8ed7eb8877d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:58.017017 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-425cb918-dcc0-4ebf-85fb-e8ed7eb8877d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:58.019407 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-43f2ad6e-7971-43ca-b29c-d9ee0386b053 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:58.019856 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-43f2ad6e-7971-43ca-b29c-d9ee0386b053 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:58.020622 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-43f2ad6e-7971-43ca-b29c-d9ee0386b053 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:58.021049 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-43f2ad6e-7971-43ca-b29c-d9ee0386b053 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:58.022701 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-425cb918-dcc0-4ebf-85fb-e8ed7eb8877d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:58.023143 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-425cb918-dcc0-4ebf-85fb-e8ed7eb8877d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:58.023892 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-425cb918-dcc0-4ebf-85fb-e8ed7eb8877d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:58.024314 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-425cb918-dcc0-4ebf-85fb-e8ed7eb8877d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:58.107013 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-43f2ad6e-7971-43ca-b29c-d9ee0386b053 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 29001 microversion: 2.1 time: 0.098130 Sep 24 03:32:58.108081 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 129/251] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:58 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 29001 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:32:58.139563 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-425cb918-dcc0-4ebf-85fb-e8ed7eb8877d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28390 microversion: 2.20 time: 0.126895 Sep 24 03:32:58.140593 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 123/252] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:58 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28390 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:32:58.510437 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f5beead8-bbc4-433f-a68c-4f6b056f6332 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:58.511133 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f5beead8-bbc4-433f-a68c-4f6b056f6332 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:58.518049 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f5beead8-bbc4-433f-a68c-4f6b056f6332 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:58.518506 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f5beead8-bbc4-433f-a68c-4f6b056f6332 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:58.519289 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f5beead8-bbc4-433f-a68c-4f6b056f6332 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:58.519729 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f5beead8-bbc4-433f-a68c-4f6b056f6332 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:58.520136 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-dfab3d37-f796-4b1e-98f3-12e53760838f tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:58.520973 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-dfab3d37-f796-4b1e-98f3-12e53760838f tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:58.529342 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dfab3d37-f796-4b1e-98f3-12e53760838f tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:58.529818 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dfab3d37-f796-4b1e-98f3-12e53760838f tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:58.530798 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dfab3d37-f796-4b1e-98f3-12e53760838f tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:58.531235 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dfab3d37-f796-4b1e-98f3-12e53760838f tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:58.713411 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-f5beead8-bbc4-433f-a68c-4f6b056f6332 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:58.715977 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-dfab3d37-f796-4b1e-98f3-12e53760838f tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:58.721254 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f5beead8-bbc4-433f-a68c-4f6b056f6332 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1317 microversion: 2.1 time: 0.215138 Sep 24 03:32:58.722049 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 130/253] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:58 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:58.723919 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-dfab3d37-f796-4b1e-98f3-12e53760838f tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1315 microversion: 2.1 time: 0.208121 Sep 24 03:32:58.724623 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 124/254] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:58 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:32:58.726064 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c0c47a15-fc59-4325-bc78-b084863dc286 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:58.726662 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c0c47a15-fc59-4325-bc78-b084863dc286 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:58.732267 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c0c47a15-fc59-4325-bc78-b084863dc286 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:58.732711 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c0c47a15-fc59-4325-bc78-b084863dc286 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:58.733472 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c0c47a15-fc59-4325-bc78-b084863dc286 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:58.734014 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c0c47a15-fc59-4325-bc78-b084863dc286 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:58.996284 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c0c47a15-fc59-4325-bc78-b084863dc286 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:32:59.004999 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c0c47a15-fc59-4325-bc78-b084863dc286 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.282166 Sep 24 03:32:59.005570 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 131/255] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:58 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:32:59.121574 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-dd154f95-26a4-4b04-bf7b-66d9f155fe6f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:59.122566 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-dd154f95-26a4-4b04-bf7b-66d9f155fe6f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:59.129098 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dd154f95-26a4-4b04-bf7b-66d9f155fe6f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:59.129659 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dd154f95-26a4-4b04-bf7b-66d9f155fe6f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:59.130500 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dd154f95-26a4-4b04-bf7b-66d9f155fe6f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:59.130925 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dd154f95-26a4-4b04-bf7b-66d9f155fe6f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:59.151975 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-70bd293f-e02f-47f6-9638-b52c74683f8d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:32:59.153268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-70bd293f-e02f-47f6-9638-b52c74683f8d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:59.159790 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-70bd293f-e02f-47f6-9638-b52c74683f8d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:59.161426 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-70bd293f-e02f-47f6-9638-b52c74683f8d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:59.162520 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-70bd293f-e02f-47f6-9638-b52c74683f8d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:59.163242 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-70bd293f-e02f-47f6-9638-b52c74683f8d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:59.217028 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-dd154f95-26a4-4b04-bf7b-66d9f155fe6f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 29001 microversion: 2.1 time: 0.098988 Sep 24 03:32:59.217767 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 125/256] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:32:59 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 29001 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:32:59.263461 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-70bd293f-e02f-47f6-9638-b52c74683f8d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28470 microversion: 2.20 time: 0.115595 Sep 24 03:32:59.264272 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 132/257] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:32:59 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28470 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:32:59.739124 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-fa5158fe-d464-49cc-b50b-456d9cc74586 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:59.740067 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-fa5158fe-d464-49cc-b50b-456d9cc74586 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:59.741868 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-57088f2d-e5ba-4726-92f2-d37937aac452 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:32:59.742625 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-57088f2d-e5ba-4726-92f2-d37937aac452 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:32:59.746351 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fa5158fe-d464-49cc-b50b-456d9cc74586 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:59.746984 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fa5158fe-d464-49cc-b50b-456d9cc74586 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:59.747737 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fa5158fe-d464-49cc-b50b-456d9cc74586 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:59.748313 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fa5158fe-d464-49cc-b50b-456d9cc74586 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:59.749318 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-57088f2d-e5ba-4726-92f2-d37937aac452 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:59.749861 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-57088f2d-e5ba-4726-92f2-d37937aac452 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:32:59.751043 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-57088f2d-e5ba-4726-92f2-d37937aac452 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:32:59.751944 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-57088f2d-e5ba-4726-92f2-d37937aac452 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:00.136312 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-fa5158fe-d464-49cc-b50b-456d9cc74586 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:00.139923 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-57088f2d-e5ba-4726-92f2-d37937aac452 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:00.146901 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-fa5158fe-d464-49cc-b50b-456d9cc74586 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1317 microversion: 2.1 time: 0.412460 Sep 24 03:33:00.147688 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 126/258] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:59 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:00.148066 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-57088f2d-e5ba-4726-92f2-d37937aac452 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1315 microversion: 2.1 time: 0.410552 Sep 24 03:33:00.152683 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d98efcf7-bf21-4a5c-911c-6c4cae5a9924 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:00.153594 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d98efcf7-bf21-4a5c-911c-6c4cae5a9924 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:00.157123 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 133/259] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:32:59 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:00.161177 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d98efcf7-bf21-4a5c-911c-6c4cae5a9924 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:00.161759 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d98efcf7-bf21-4a5c-911c-6c4cae5a9924 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:00.162532 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d98efcf7-bf21-4a5c-911c-6c4cae5a9924 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:00.162966 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d98efcf7-bf21-4a5c-911c-6c4cae5a9924 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:00.230938 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-074c97ed-e5fb-4b29-bc84-128af8545ae5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:00.232023 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-074c97ed-e5fb-4b29-bc84-128af8545ae5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:00.238737 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-074c97ed-e5fb-4b29-bc84-128af8545ae5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:00.239177 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-074c97ed-e5fb-4b29-bc84-128af8545ae5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:00.240206 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-074c97ed-e5fb-4b29-bc84-128af8545ae5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:00.240627 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-074c97ed-e5fb-4b29-bc84-128af8545ae5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:00.289997 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d98efcf7-bf21-4a5c-911c-6c4cae5a9924 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:00.297284 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d98efcf7-bf21-4a5c-911c-6c4cae5a9924 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.148157 Sep 24 03:33:00.298666 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 127/260] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:00 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:00.303391 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e2a706fc-46c2-4780-be3f-b62f66f5c48a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:00.304347 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e2a706fc-46c2-4780-be3f-b62f66f5c48a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:00.310644 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e2a706fc-46c2-4780-be3f-b62f66f5c48a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:00.311088 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e2a706fc-46c2-4780-be3f-b62f66f5c48a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:00.311847 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e2a706fc-46c2-4780-be3f-b62f66f5c48a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:00.312272 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e2a706fc-46c2-4780-be3f-b62f66f5c48a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:00.330630 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-074c97ed-e5fb-4b29-bc84-128af8545ae5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 29001 microversion: 2.1 time: 0.103544 Sep 24 03:33:00.331411 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 134/261] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:00 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 29001 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:33:00.417782 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e2a706fc-46c2-4780-be3f-b62f66f5c48a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28636 microversion: 2.20 time: 0.117382 Sep 24 03:33:00.418731 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 128/262] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:00 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28636 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:01.164273 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-dbe259bf-14bd-45c1-a77d-bb2de930f30b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:01.165015 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-dbe259bf-14bd-45c1-a77d-bb2de930f30b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:01.166628 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-42ea0d46-fb79-4c08-9459-11108b7055c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:01.167272 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-42ea0d46-fb79-4c08-9459-11108b7055c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:01.173608 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dbe259bf-14bd-45c1-a77d-bb2de930f30b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:01.174240 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dbe259bf-14bd-45c1-a77d-bb2de930f30b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:01.174668 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-42ea0d46-fb79-4c08-9459-11108b7055c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:01.175024 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dbe259bf-14bd-45c1-a77d-bb2de930f30b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:01.175357 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-42ea0d46-fb79-4c08-9459-11108b7055c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:01.175459 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dbe259bf-14bd-45c1-a77d-bb2de930f30b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:01.176123 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-42ea0d46-fb79-4c08-9459-11108b7055c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:01.176548 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-42ea0d46-fb79-4c08-9459-11108b7055c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:01.344357 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-dbe259bf-14bd-45c1-a77d-bb2de930f30b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:01.353645 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-dbe259bf-14bd-45c1-a77d-bb2de930f30b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1317 microversion: 2.1 time: 0.193322 Sep 24 03:33:01.354891 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 135/263] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:01 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:01.357606 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-42ea0d46-fb79-4c08-9459-11108b7055c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:01.359272 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ed1a3371-9a5f-40f5-a703-c7842cb70779 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:01.359864 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ed1a3371-9a5f-40f5-a703-c7842cb70779 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:01.365845 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-42ea0d46-fb79-4c08-9459-11108b7055c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1315 microversion: 2.1 time: 0.205187 Sep 24 03:33:01.366136 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ed1a3371-9a5f-40f5-a703-c7842cb70779 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:01.366748 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ed1a3371-9a5f-40f5-a703-c7842cb70779 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:01.367076 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 129/264] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:01 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:01.371668 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c36c0150-b291-4877-a1ea-7e85e0d92e78 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:01.372640 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c36c0150-b291-4877-a1ea-7e85e0d92e78 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:01.374345 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ed1a3371-9a5f-40f5-a703-c7842cb70779 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:01.374851 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ed1a3371-9a5f-40f5-a703-c7842cb70779 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:01.379234 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c36c0150-b291-4877-a1ea-7e85e0d92e78 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:01.379748 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c36c0150-b291-4877-a1ea-7e85e0d92e78 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:01.380647 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c36c0150-b291-4877-a1ea-7e85e0d92e78 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:01.381214 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c36c0150-b291-4877-a1ea-7e85e0d92e78 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:01.453530 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c36c0150-b291-4877-a1ea-7e85e0d92e78 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 29001 microversion: 2.1 time: 0.084984 Sep 24 03:33:01.454661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 130/265] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:01 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 29001 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:33:01.459825 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a0d5296d-fe3e-4321-be5a-aff1c5443972 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:01.461025 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a0d5296d-fe3e-4321-be5a-aff1c5443972 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:01.467483 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a0d5296d-fe3e-4321-be5a-aff1c5443972 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:01.467924 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a0d5296d-fe3e-4321-be5a-aff1c5443972 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:01.468849 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a0d5296d-fe3e-4321-be5a-aff1c5443972 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:01.469438 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a0d5296d-fe3e-4321-be5a-aff1c5443972 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:01.507048 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ed1a3371-9a5f-40f5-a703-c7842cb70779 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:01.524920 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ed1a3371-9a5f-40f5-a703-c7842cb70779 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.168891 Sep 24 03:33:01.525506 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 136/266] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:01 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:01.547738 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a0d5296d-fe3e-4321-be5a-aff1c5443972 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28636 microversion: 2.20 time: 0.091491 Sep 24 03:33:01.552866 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 131/267] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:01 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28636 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:02.270675 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-be9641d6-27ae-49fd-8ee9-dba8d9bdb7b7 req-7a6f1eb5-b26f-4c60-8663-a7b8f545170d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e63e97-71b1-48b6-af18-ea2f33d55dd3", "name": "network-vif-plugged", "status": "completed", "tag": "560c4fee-dbda-4b10-966d-3589544f945a"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:02.274492 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:33:02.274492 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:33:02.284294 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-be9641d6-27ae-49fd-8ee9-dba8d9bdb7b7 req-7a6f1eb5-b26f-4c60-8663-a7b8f545170d service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:02.285133 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-be9641d6-27ae-49fd-8ee9-dba8d9bdb7b7 req-7a6f1eb5-b26f-4c60-8663-a7b8f545170d service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:02.299631 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-be9641d6-27ae-49fd-8ee9-dba8d9bdb7b7 req-7a6f1eb5-b26f-4c60-8663-a7b8f545170d service nova] Creating event network-vif-plugged:560c4fee-dbda-4b10-966d-3589544f945a for instance d7e63e97-71b1-48b6-af18-ea2f33d55dd3 on hv-cinder-81080 Sep 24 03:33:02.304493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-be9641d6-27ae-49fd-8ee9-dba8d9bdb7b7 req-7a6f1eb5-b26f-4c60-8663-a7b8f545170d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040267 Sep 24 03:33:02.305083 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 137/268] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:33:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:33:02.372961 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-20097199-ec7b-4f12-ae3c-f63e11e2b0a7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:02.373767 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-20097199-ec7b-4f12-ae3c-f63e11e2b0a7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:02.383931 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-20097199-ec7b-4f12-ae3c-f63e11e2b0a7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:02.384388 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-20097199-ec7b-4f12-ae3c-f63e11e2b0a7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:02.385254 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-20097199-ec7b-4f12-ae3c-f63e11e2b0a7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:02.385604 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0ea3562e-b216-4e44-847b-178852fc2af1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:02.386175 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-20097199-ec7b-4f12-ae3c-f63e11e2b0a7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:02.386321 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0ea3562e-b216-4e44-847b-178852fc2af1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:02.398460 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0ea3562e-b216-4e44-847b-178852fc2af1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:02.399199 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0ea3562e-b216-4e44-847b-178852fc2af1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:02.400215 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0ea3562e-b216-4e44-847b-178852fc2af1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:02.400869 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0ea3562e-b216-4e44-847b-178852fc2af1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:02.592585 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-20097199-ec7b-4f12-ae3c-f63e11e2b0a7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:02.599032 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0ea3562e-b216-4e44-847b-178852fc2af1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:02.600504 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-20097199-ec7b-4f12-ae3c-f63e11e2b0a7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1317 microversion: 2.1 time: 0.231965 Sep 24 03:33:02.609560 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 132/269] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:02 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:02.609560 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9da15c09-ec83-4f97-8c10-dcc4f8c59c3d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:02.609560 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9da15c09-ec83-4f97-8c10-dcc4f8c59c3d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:02.612560 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9da15c09-ec83-4f97-8c10-dcc4f8c59c3d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:02.612995 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9da15c09-ec83-4f97-8c10-dcc4f8c59c3d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:02.613787 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9da15c09-ec83-4f97-8c10-dcc4f8c59c3d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:02.614210 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9da15c09-ec83-4f97-8c10-dcc4f8c59c3d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:02.615396 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0ea3562e-b216-4e44-847b-178852fc2af1 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1315 microversion: 2.1 time: 0.234557 Sep 24 03:33:02.616359 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 138/270] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:02 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:02.622223 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-198496a9-003e-4ff8-b8d0-10a596ad0479 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:02.623016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-198496a9-003e-4ff8-b8d0-10a596ad0479 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:02.630960 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-198496a9-003e-4ff8-b8d0-10a596ad0479 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:02.631409 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-198496a9-003e-4ff8-b8d0-10a596ad0479 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:02.632184 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-198496a9-003e-4ff8-b8d0-10a596ad0479 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:02.633207 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-198496a9-003e-4ff8-b8d0-10a596ad0479 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:02.756785 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-198496a9-003e-4ff8-b8d0-10a596ad0479 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:02.763980 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-198496a9-003e-4ff8-b8d0-10a596ad0479 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1521 microversion: 2.1 time: 0.146312 Sep 24 03:33:02.764477 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 139/271] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:02 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:02.769022 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ce08aa77-c13e-4143-9a93-ec652e124192 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:02.769986 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ce08aa77-c13e-4143-9a93-ec652e124192 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:02.775434 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ce08aa77-c13e-4143-9a93-ec652e124192 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:02.775873 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ce08aa77-c13e-4143-9a93-ec652e124192 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:02.776624 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ce08aa77-c13e-4143-9a93-ec652e124192 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:02.777041 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ce08aa77-c13e-4143-9a93-ec652e124192 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:02.882544 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9da15c09-ec83-4f97-8c10-dcc4f8c59c3d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 29001 microversion: 2.1 time: 0.279725 Sep 24 03:33:02.883200 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 133/272] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:02 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 29001 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:33:02.896592 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ce08aa77-c13e-4143-9a93-ec652e124192 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28636 microversion: 2.20 time: 0.130941 Sep 24 03:33:02.897207 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 140/273] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:02 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28636 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:03.618984 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-bdbae366-1c6e-4043-91c4-5c3abec7e477 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:03.619592 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-bdbae366-1c6e-4043-91c4-5c3abec7e477 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:03.628601 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bdbae366-1c6e-4043-91c4-5c3abec7e477 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:03.629050 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bdbae366-1c6e-4043-91c4-5c3abec7e477 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:03.629869 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bdbae366-1c6e-4043-91c4-5c3abec7e477 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:03.630283 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bdbae366-1c6e-4043-91c4-5c3abec7e477 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:03.634012 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-926355ce-6313-4f2d-b51f-f7fb732969c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:03.635433 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-926355ce-6313-4f2d-b51f-f7fb732969c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:03.644271 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-926355ce-6313-4f2d-b51f-f7fb732969c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:03.644799 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-926355ce-6313-4f2d-b51f-f7fb732969c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:03.645857 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-926355ce-6313-4f2d-b51f-f7fb732969c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:03.646474 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-926355ce-6313-4f2d-b51f-f7fb732969c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:03.812529 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-bdbae366-1c6e-4043-91c4-5c3abec7e477 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:03.821735 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-bdbae366-1c6e-4043-91c4-5c3abec7e477 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1317 microversion: 2.1 time: 0.208043 Sep 24 03:33:03.822669 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 134/274] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:03 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:03.827151 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-892bc614-ecb5-4d09-90a0-b4475cc51f34 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:03.827868 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-892bc614-ecb5-4d09-90a0-b4475cc51f34 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:03.834514 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-892bc614-ecb5-4d09-90a0-b4475cc51f34 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:03.835064 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-892bc614-ecb5-4d09-90a0-b4475cc51f34 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:03.835949 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-892bc614-ecb5-4d09-90a0-b4475cc51f34 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:03.836487 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-892bc614-ecb5-4d09-90a0-b4475cc51f34 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:03.840141 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-926355ce-6313-4f2d-b51f-f7fb732969c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:03.847890 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-926355ce-6313-4f2d-b51f-f7fb732969c8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1315 microversion: 2.1 time: 0.218358 Sep 24 03:33:03.848458 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 141/275] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:03 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:03.894092 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-70e88c98-ddac-4e90-8f1c-efc59af5e085 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:03.894920 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-70e88c98-ddac-4e90-8f1c-efc59af5e085 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:03.900591 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-70e88c98-ddac-4e90-8f1c-efc59af5e085 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:03.901038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-70e88c98-ddac-4e90-8f1c-efc59af5e085 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:03.903259 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-70e88c98-ddac-4e90-8f1c-efc59af5e085 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:03.903259 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-70e88c98-ddac-4e90-8f1c-efc59af5e085 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:03.957447 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-892bc614-ecb5-4d09-90a0-b4475cc51f34 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:03.964654 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-892bc614-ecb5-4d09-90a0-b4475cc51f34 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1501 microversion: 2.1 time: 0.140875 Sep 24 03:33:03.965249 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 135/276] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:03 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1501 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:03.969541 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-48800327-137f-410f-b939-8351411b8576 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:03.971075 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-48800327-137f-410f-b939-8351411b8576 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:03.977547 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-48800327-137f-410f-b939-8351411b8576 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:03.977849 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-70e88c98-ddac-4e90-8f1c-efc59af5e085 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 29001 microversion: 2.1 time: 0.088073 Sep 24 03:33:03.978032 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-48800327-137f-410f-b939-8351411b8576 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:03.978810 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 142/277] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:03 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 29001 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:33:03.978914 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-48800327-137f-410f-b939-8351411b8576 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:03.979285 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-48800327-137f-410f-b939-8351411b8576 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:03.983709 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7a4c6235-3adb-45cb-b17f-d6e9887c4e7d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:03.984383 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-7a4c6235-3adb-45cb-b17f-d6e9887c4e7d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:03.991035 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7a4c6235-3adb-45cb-b17f-d6e9887c4e7d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:03.991470 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7a4c6235-3adb-45cb-b17f-d6e9887c4e7d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:03.992222 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7a4c6235-3adb-45cb-b17f-d6e9887c4e7d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:03.992643 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7a4c6235-3adb-45cb-b17f-d6e9887c4e7d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:04.088046 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-48800327-137f-410f-b939-8351411b8576 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28636 microversion: 2.20 time: 0.121536 Sep 24 03:33:04.089004 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 136/278] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:03 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28636 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:04.113564 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7a4c6235-3adb-45cb-b17f-d6e9887c4e7d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:04.121110 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7a4c6235-3adb-45cb-b17f-d6e9887c4e7d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1515 microversion: 2.1 time: 0.141023 Sep 24 03:33:04.121670 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 143/279] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:03 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1515 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:04.363500 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-e9a084cb-91d6-46c7-9f22-4c0f8f466636 req-196b917e-d6a2-45b7-9ef8-7b8af771f92e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1b5536-1ee4-4d4a-bafa-1c4dd0369704", "name": "network-vif-plugged", "status": "completed", "tag": "1744bf94-58fc-4c5d-9551-1fa3f491967c"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:04.365294 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:33:04.365294 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:33:04.374028 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-e9a084cb-91d6-46c7-9f22-4c0f8f466636 req-196b917e-d6a2-45b7-9ef8-7b8af771f92e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:04.374639 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-e9a084cb-91d6-46c7-9f22-4c0f8f466636 req-196b917e-d6a2-45b7-9ef8-7b8af771f92e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:04.386241 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-e9a084cb-91d6-46c7-9f22-4c0f8f466636 req-196b917e-d6a2-45b7-9ef8-7b8af771f92e service nova] Creating event network-vif-plugged:1744bf94-58fc-4c5d-9551-1fa3f491967c for instance 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 on hv-cinder-81080 Sep 24 03:33:04.391110 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-e9a084cb-91d6-46c7-9f22-4c0f8f466636 req-196b917e-d6a2-45b7-9ef8-7b8af771f92e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031562 Sep 24 03:33:04.392564 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 137/280] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:33:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:33:04.839070 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2a011bb9-1cb4-47b5-85a2-b1be16f71bb7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:04.839679 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2a011bb9-1cb4-47b5-85a2-b1be16f71bb7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:04.845505 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a011bb9-1cb4-47b5-85a2-b1be16f71bb7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:04.846026 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a011bb9-1cb4-47b5-85a2-b1be16f71bb7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:04.846765 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a011bb9-1cb4-47b5-85a2-b1be16f71bb7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:04.847197 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a011bb9-1cb4-47b5-85a2-b1be16f71bb7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:04.864888 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-96db8b6f-5c79-495d-beb1-39440dcf1290 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:04.865615 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-96db8b6f-5c79-495d-beb1-39440dcf1290 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:04.872356 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-96db8b6f-5c79-495d-beb1-39440dcf1290 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:04.872853 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-96db8b6f-5c79-495d-beb1-39440dcf1290 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:04.873624 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-96db8b6f-5c79-495d-beb1-39440dcf1290 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:04.874124 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-96db8b6f-5c79-495d-beb1-39440dcf1290 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:05.001486 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2a011bb9-1cb4-47b5-85a2-b1be16f71bb7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:05.015117 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2a011bb9-1cb4-47b5-85a2-b1be16f71bb7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1506 microversion: 2.1 time: 0.179641 Sep 24 03:33:05.015704 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 144/281] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:04 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:05.020608 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-30bfdadf-9635-418d-9cd4-636614314ba2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:05.021578 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-30bfdadf-9635-418d-9cd4-636614314ba2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:05.027531 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30bfdadf-9635-418d-9cd4-636614314ba2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:05.028189 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30bfdadf-9635-418d-9cd4-636614314ba2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:05.029237 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30bfdadf-9635-418d-9cd4-636614314ba2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:05.029854 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30bfdadf-9635-418d-9cd4-636614314ba2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:05.049481 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-96db8b6f-5c79-495d-beb1-39440dcf1290 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:05.057798 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-96db8b6f-5c79-495d-beb1-39440dcf1290 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1315 microversion: 2.1 time: 0.197099 Sep 24 03:33:05.059076 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 138/282] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:04 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:05.099721 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-189947ec-f61e-4865-be39-a742db6bf260 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:05.100711 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-189947ec-f61e-4865-be39-a742db6bf260 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:05.106624 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-189947ec-f61e-4865-be39-a742db6bf260 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:05.107132 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-189947ec-f61e-4865-be39-a742db6bf260 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:05.108051 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-189947ec-f61e-4865-be39-a742db6bf260 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:05.108555 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-189947ec-f61e-4865-be39-a742db6bf260 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:05.166901 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-30bfdadf-9635-418d-9cd4-636614314ba2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 29684 microversion: 2.1 time: 0.149455 Sep 24 03:33:05.167779 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 145/283] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:05 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 29684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:33:05.257132 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-189947ec-f61e-4865-be39-a742db6bf260 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28636 microversion: 2.20 time: 0.161216 Sep 24 03:33:05.257810 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 139/284] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:05 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28636 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:33:05.479721 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-cf0b09f0-f897-4d3e-ab6d-3a0c4708de5a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:05.480883 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-cf0b09f0-f897-4d3e-ab6d-3a0c4708de5a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:05.487874 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cf0b09f0-f897-4d3e-ab6d-3a0c4708de5a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:05.488314 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cf0b09f0-f897-4d3e-ab6d-3a0c4708de5a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:05.489243 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cf0b09f0-f897-4d3e-ab6d-3a0c4708de5a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:05.489984 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cf0b09f0-f897-4d3e-ab6d-3a0c4708de5a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:05.513047 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.objects.instance [None req-cf0b09f0-f897-4d3e-ab6d-3a0c4708de5a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lazy-loading 'flavor' on Instance uuid 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 {{(pid=109374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:33:05.628287 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-cf0b09f0-f897-4d3e-ab6d-3a0c4708de5a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "POST /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/action" status: 200 len: 32 microversion: 2.1 time: 0.152768 Sep 24 03:33:05.628950 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 146/285] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:05 2021] POST /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:33:05.638497 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a0592c07-edea-4e31-9d24-34d0b9873595 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:05.639533 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a0592c07-edea-4e31-9d24-34d0b9873595 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:05.647535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a0592c07-edea-4e31-9d24-34d0b9873595 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:05.648207 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a0592c07-edea-4e31-9d24-34d0b9873595 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:05.649046 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a0592c07-edea-4e31-9d24-34d0b9873595 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:05.649492 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a0592c07-edea-4e31-9d24-34d0b9873595 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:05.819463 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a0592c07-edea-4e31-9d24-34d0b9873595 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:05.827150 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a0592c07-edea-4e31-9d24-34d0b9873595 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.192620 Sep 24 03:33:05.828043 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 140/286] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:05 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:06.076375 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f0d099f9-a6f1-43a8-ab18-713a8ca04dd7 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:06.077815 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f0d099f9-a6f1-43a8-ab18-713a8ca04dd7 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:06.084258 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f0d099f9-a6f1-43a8-ab18-713a8ca04dd7 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:06.084697 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f0d099f9-a6f1-43a8-ab18-713a8ca04dd7 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:06.085808 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f0d099f9-a6f1-43a8-ab18-713a8ca04dd7 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:06.086233 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f0d099f9-a6f1-43a8-ab18-713a8ca04dd7 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:06.180404 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3f324130-0644-4816-9dd8-9408cc0ae995 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:06.181323 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3f324130-0644-4816-9dd8-9408cc0ae995 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:06.191184 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3f324130-0644-4816-9dd8-9408cc0ae995 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:06.192919 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3f324130-0644-4816-9dd8-9408cc0ae995 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:06.194149 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3f324130-0644-4816-9dd8-9408cc0ae995 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:06.194914 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3f324130-0644-4816-9dd8-9408cc0ae995 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:06.247991 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-f0d099f9-a6f1-43a8-ab18-713a8ca04dd7 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:06.257521 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f0d099f9-a6f1-43a8-ab18-713a8ca04dd7 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1315 microversion: 2.1 time: 0.185475 Sep 24 03:33:06.257521 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 147/287] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:06 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:06.271453 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-dcf64b47-7ee1-420f-a805-97b471d6a4a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:06.273157 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-dcf64b47-7ee1-420f-a805-97b471d6a4a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:06.280200 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dcf64b47-7ee1-420f-a805-97b471d6a4a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:06.280640 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dcf64b47-7ee1-420f-a805-97b471d6a4a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:06.281419 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dcf64b47-7ee1-420f-a805-97b471d6a4a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:06.281903 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dcf64b47-7ee1-420f-a805-97b471d6a4a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:06.343263 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3f324130-0644-4816-9dd8-9408cc0ae995 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 30857 microversion: 2.1 time: 0.167005 Sep 24 03:33:06.345765 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 141/288] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:06 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 30857 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:33:06.400891 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-100d1ca6-ec30-4e90-8199-0efd1c76e916 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c80ff931-c723-45e8-b558-76f5c4eca87d"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:06.402231 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-100d1ca6-ec30-4e90-8199-0efd1c76e916 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:06.408763 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-100d1ca6-ec30-4e90-8199-0efd1c76e916 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:06.409463 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-100d1ca6-ec30-4e90-8199-0efd1c76e916 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:06.410569 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-100d1ca6-ec30-4e90-8199-0efd1c76e916 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:06.411696 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-100d1ca6-ec30-4e90-8199-0efd1c76e916 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:06.452100 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-dcf64b47-7ee1-420f-a805-97b471d6a4a0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28636 microversion: 2.20 time: 0.184906 Sep 24 03:33:06.457588 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 148/289] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:06 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28636 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:33:06.722326 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-100d1ca6-ec30-4e90-8199-0efd1c76e916 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "POST /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326446 Sep 24 03:33:06.728451 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 142/290] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:33:06 2021] POST /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:33:06.844204 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-96661d63-c815-422c-b82f-ccb980d3a3dd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:06.849502 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-96661d63-c815-422c-b82f-ccb980d3a3dd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:06.865155 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-96661d63-c815-422c-b82f-ccb980d3a3dd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:06.865565 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-96661d63-c815-422c-b82f-ccb980d3a3dd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:06.866371 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-96661d63-c815-422c-b82f-ccb980d3a3dd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:06.866976 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-96661d63-c815-422c-b82f-ccb980d3a3dd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:07.004069 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-96661d63-c815-422c-b82f-ccb980d3a3dd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:07.011457 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-96661d63-c815-422c-b82f-ccb980d3a3dd tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.171278 Sep 24 03:33:07.012188 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 149/291] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:06 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:07.275485 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ec9a76c8-6865-44cb-9db7-372b4425d5a8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:07.276290 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ec9a76c8-6865-44cb-9db7-372b4425d5a8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:07.284563 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ec9a76c8-6865-44cb-9db7-372b4425d5a8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:07.285189 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ec9a76c8-6865-44cb-9db7-372b4425d5a8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:07.286319 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ec9a76c8-6865-44cb-9db7-372b4425d5a8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:07.286748 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ec9a76c8-6865-44cb-9db7-372b4425d5a8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:07.356705 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-65bd6805-b0e5-4106-b2c6-40be423aea8b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:07.357670 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-65bd6805-b0e5-4106-b2c6-40be423aea8b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:07.364469 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-65bd6805-b0e5-4106-b2c6-40be423aea8b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:07.365168 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-65bd6805-b0e5-4106-b2c6-40be423aea8b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:07.366166 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-65bd6805-b0e5-4106-b2c6-40be423aea8b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:07.366591 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-65bd6805-b0e5-4106-b2c6-40be423aea8b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:07.418195 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ec9a76c8-6865-44cb-9db7-372b4425d5a8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:07.425760 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ec9a76c8-6865-44cb-9db7-372b4425d5a8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1465 microversion: 2.1 time: 0.154830 Sep 24 03:33:07.426793 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 143/292] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:07 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:07.464208 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-38f7f93b-a7c4-40ae-89c9-0c6eae0f89ef tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:07.465191 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-38f7f93b-a7c4-40ae-89c9-0c6eae0f89ef tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:07.468548 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-65bd6805-b0e5-4106-b2c6-40be423aea8b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 31986 microversion: 2.1 time: 0.115258 Sep 24 03:33:07.471347 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 150/293] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:07 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 31986 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:33:07.471749 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-38f7f93b-a7c4-40ae-89c9-0c6eae0f89ef tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:07.472205 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-38f7f93b-a7c4-40ae-89c9-0c6eae0f89ef tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:07.475830 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-38f7f93b-a7c4-40ae-89c9-0c6eae0f89ef tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:07.476310 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-38f7f93b-a7c4-40ae-89c9-0c6eae0f89ef tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:07.477222 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6ddd07ba-2a79-4b87-955b-2a57c28a6ef4 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:07.477822 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6ddd07ba-2a79-4b87-955b-2a57c28a6ef4 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:07.484304 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6ddd07ba-2a79-4b87-955b-2a57c28a6ef4 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:07.484731 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6ddd07ba-2a79-4b87-955b-2a57c28a6ef4 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:07.486451 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6ddd07ba-2a79-4b87-955b-2a57c28a6ef4 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:07.486875 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6ddd07ba-2a79-4b87-955b-2a57c28a6ef4 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:07.512876 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6ddd07ba-2a79-4b87-955b-2a57c28a6ef4 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Going to try to terminate instance {{(pid=109374) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:33:07.558182 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-38f7f93b-a7c4-40ae-89c9-0c6eae0f89ef tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28636 microversion: 2.20 time: 0.097324 Sep 24 03:33:07.561760 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 144/294] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:07 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28636 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:33:07.593313 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6ddd07ba-2a79-4b87-955b-2a57c28a6ef4 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 204 len: 0 microversion: 2.1 time: 0.119567 Sep 24 03:33:07.594408 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 151/295] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:33:07 2021] DELETE /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:33:07.603353 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5c6ef51a-e074-4d03-b01e-e710fe9083dc tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:07.604047 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5c6ef51a-e074-4d03-b01e-e710fe9083dc tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:07.610916 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5c6ef51a-e074-4d03-b01e-e710fe9083dc tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:07.611369 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5c6ef51a-e074-4d03-b01e-e710fe9083dc tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:07.612139 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5c6ef51a-e074-4d03-b01e-e710fe9083dc tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:07.612566 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5c6ef51a-e074-4d03-b01e-e710fe9083dc tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:07.735842 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5c6ef51a-e074-4d03-b01e-e710fe9083dc tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:07.743549 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5c6ef51a-e074-4d03-b01e-e710fe9083dc tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1471 microversion: 2.1 time: 0.144079 Sep 24 03:33:07.744119 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 145/296] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:07 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1471 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:08.029584 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f71f14b4-0e77-4cfb-801c-c05381d55cc2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:08.030432 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f71f14b4-0e77-4cfb-801c-c05381d55cc2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:08.036239 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f71f14b4-0e77-4cfb-801c-c05381d55cc2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:08.037273 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f71f14b4-0e77-4cfb-801c-c05381d55cc2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:08.038129 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f71f14b4-0e77-4cfb-801c-c05381d55cc2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:08.038575 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f71f14b4-0e77-4cfb-801c-c05381d55cc2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:08.161624 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-f71f14b4-0e77-4cfb-801c-c05381d55cc2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:08.170843 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f71f14b4-0e77-4cfb-801c-c05381d55cc2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.145274 Sep 24 03:33:08.171409 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 152/297] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:08 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:08.481474 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-51aec284-58a0-4b44-8f62-e36c1922ef37 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:08.482414 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-51aec284-58a0-4b44-8f62-e36c1922ef37 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:08.489244 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-51aec284-58a0-4b44-8f62-e36c1922ef37 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:08.489970 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-51aec284-58a0-4b44-8f62-e36c1922ef37 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:08.490724 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-51aec284-58a0-4b44-8f62-e36c1922ef37 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:08.491218 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-51aec284-58a0-4b44-8f62-e36c1922ef37 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:08.569432 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3c89b1f0-253d-4129-8c1f-0cd14e4b668b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:08.570366 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3c89b1f0-253d-4129-8c1f-0cd14e4b668b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:08.576282 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-51aec284-58a0-4b44-8f62-e36c1922ef37 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 32906 microversion: 2.1 time: 0.098270 Sep 24 03:33:08.576682 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3c89b1f0-253d-4129-8c1f-0cd14e4b668b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:08.580340 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 146/298] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:08 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 32906 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:33:08.581136 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3c89b1f0-253d-4129-8c1f-0cd14e4b668b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:08.581136 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3c89b1f0-253d-4129-8c1f-0cd14e4b668b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:08.581136 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3c89b1f0-253d-4129-8c1f-0cd14e4b668b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:08.656976 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3c89b1f0-253d-4129-8c1f-0cd14e4b668b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 28636 microversion: 2.20 time: 0.091095 Sep 24 03:33:08.657626 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 153/299] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:08 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 28636 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:33:08.760892 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b98c4934-1584-4885-852a-75171bb3cb55 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:08.761588 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b98c4934-1584-4885-852a-75171bb3cb55 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:08.769001 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b98c4934-1584-4885-852a-75171bb3cb55 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:08.769141 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b98c4934-1584-4885-852a-75171bb3cb55 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:08.769937 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b98c4934-1584-4885-852a-75171bb3cb55 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:08.770715 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b98c4934-1584-4885-852a-75171bb3cb55 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:08.935267 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b98c4934-1584-4885-852a-75171bb3cb55 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:08.943117 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b98c4934-1584-4885-852a-75171bb3cb55 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1471 microversion: 2.1 time: 0.186188 Sep 24 03:33:08.943679 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 147/300] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:08 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1471 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:09.188544 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3a19c18f-3d04-4111-b12f-5353d2944b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:09.189303 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3a19c18f-3d04-4111-b12f-5353d2944b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:09.196921 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3a19c18f-3d04-4111-b12f-5353d2944b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:09.197364 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3a19c18f-3d04-4111-b12f-5353d2944b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:09.198268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3a19c18f-3d04-4111-b12f-5353d2944b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:09.198576 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3a19c18f-3d04-4111-b12f-5353d2944b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:09.382796 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3a19c18f-3d04-4111-b12f-5353d2944b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:09.391279 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3a19c18f-3d04-4111-b12f-5353d2944b8b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.206694 Sep 24 03:33:09.391856 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 154/301] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:09 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:09.587387 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-0fca271a-e25b-4bb1-aa52-e4e4af2016c0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:09.588296 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-0fca271a-e25b-4bb1-aa52-e4e4af2016c0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:09.594200 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0fca271a-e25b-4bb1-aa52-e4e4af2016c0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:09.594643 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0fca271a-e25b-4bb1-aa52-e4e4af2016c0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:09.595575 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0fca271a-e25b-4bb1-aa52-e4e4af2016c0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:09.596550 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0fca271a-e25b-4bb1-aa52-e4e4af2016c0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:09.669493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0f1d14fd-3178-4153-b3a7-2aa64c6b6be6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:09.670444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0f1d14fd-3178-4153-b3a7-2aa64c6b6be6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:09.677461 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0f1d14fd-3178-4153-b3a7-2aa64c6b6be6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:09.677984 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0f1d14fd-3178-4153-b3a7-2aa64c6b6be6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:09.678755 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0f1d14fd-3178-4153-b3a7-2aa64c6b6be6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:09.679199 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0f1d14fd-3178-4153-b3a7-2aa64c6b6be6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:09.702698 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-0fca271a-e25b-4bb1-aa52-e4e4af2016c0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 33346 microversion: 2.1 time: 0.118767 Sep 24 03:33:09.709389 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 148/302] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:09 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 33346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:33:09.772166 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0f1d14fd-3178-4153-b3a7-2aa64c6b6be6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 29161 microversion: 2.20 time: 0.106359 Sep 24 03:33:09.773365 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 155/303] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:09 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 29161 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:33:09.961885 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-47213dfe-9197-4ed8-ae48-22147554d2aa tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:09.963166 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-47213dfe-9197-4ed8-ae48-22147554d2aa tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:09.970457 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-47213dfe-9197-4ed8-ae48-22147554d2aa tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:09.972182 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-47213dfe-9197-4ed8-ae48-22147554d2aa tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:09.973286 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-47213dfe-9197-4ed8-ae48-22147554d2aa tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:09.973956 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-47213dfe-9197-4ed8-ae48-22147554d2aa tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:10.106946 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-47213dfe-9197-4ed8-ae48-22147554d2aa tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b3bbfc64c346eba2b16ede0d45a1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8519cf314421b5dffddf43fff375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:10.115622 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-47213dfe-9197-4ed8-ae48-22147554d2aa tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 200 len: 1471 microversion: 2.1 time: 0.158180 Sep 24 03:33:10.116207 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 149/304] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:09 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:10.234138 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-f7099331-6c06-4083-9bff-594e54afec99 req-08a5e34c-a8b1-4bac-9ada-0163da4940bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1b5536-1ee4-4d4a-bafa-1c4dd0369704", "name": "network-vif-deleted", "tag": "1744bf94-58fc-4c5d-9551-1fa3f491967c"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:10.235677 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:33:10.235677 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:33:10.244390 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-f7099331-6c06-4083-9bff-594e54afec99 req-08a5e34c-a8b1-4bac-9ada-0163da4940bf service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:10.244825 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-f7099331-6c06-4083-9bff-594e54afec99 req-08a5e34c-a8b1-4bac-9ada-0163da4940bf service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:10.256212 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-f7099331-6c06-4083-9bff-594e54afec99 req-08a5e34c-a8b1-4bac-9ada-0163da4940bf service nova] Creating event network-vif-deleted:1744bf94-58fc-4c5d-9551-1fa3f491967c for instance 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 on hv-cinder-81080 Sep 24 03:33:10.265837 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-f7099331-6c06-4083-9bff-594e54afec99 req-08a5e34c-a8b1-4bac-9ada-0163da4940bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035718 Sep 24 03:33:10.266446 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 156/305] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:33:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:33:10.408521 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5ed181fb-4e62-4fd4-a1f0-f72483ad302b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:10.409373 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5ed181fb-4e62-4fd4-a1f0-f72483ad302b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:10.415936 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5ed181fb-4e62-4fd4-a1f0-f72483ad302b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:10.416499 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5ed181fb-4e62-4fd4-a1f0-f72483ad302b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:10.417320 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5ed181fb-4e62-4fd4-a1f0-f72483ad302b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:10.417793 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5ed181fb-4e62-4fd4-a1f0-f72483ad302b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:10.543521 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5ed181fb-4e62-4fd4-a1f0-f72483ad302b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:10.551918 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5ed181fb-4e62-4fd4-a1f0-f72483ad302b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.147243 Sep 24 03:33:10.552528 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 150/306] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:10 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:10.716004 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f277e209-278a-43b0-9048-a99958161add tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:10.717044 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f277e209-278a-43b0-9048-a99958161add tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:10.723784 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f277e209-278a-43b0-9048-a99958161add tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:10.724233 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f277e209-278a-43b0-9048-a99958161add tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:10.725008 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f277e209-278a-43b0-9048-a99958161add tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:10.725440 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f277e209-278a-43b0-9048-a99958161add tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:10.786268 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b29dbd3a-505f-4edd-b7de-3b7c2c5d0ae6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:10.787238 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b29dbd3a-505f-4edd-b7de-3b7c2c5d0ae6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:10.793673 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b29dbd3a-505f-4edd-b7de-3b7c2c5d0ae6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:10.794142 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b29dbd3a-505f-4edd-b7de-3b7c2c5d0ae6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:10.794926 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b29dbd3a-505f-4edd-b7de-3b7c2c5d0ae6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:10.795828 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b29dbd3a-505f-4edd-b7de-3b7c2c5d0ae6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:10.851355 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f277e209-278a-43b0-9048-a99958161add tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 33834 microversion: 2.1 time: 0.139323 Sep 24 03:33:10.852182 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 157/307] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:10 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 33834 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:33:10.904328 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b29dbd3a-505f-4edd-b7de-3b7c2c5d0ae6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 30410 microversion: 2.20 time: 0.123658 Sep 24 03:33:10.904988 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 151/308] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:10 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 30410 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:11.132986 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ab28de87-cfb6-42c2-adf1-e3c6ad48d7b8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:11.133738 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ab28de87-cfb6-42c2-adf1-e3c6ad48d7b8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] [instance: 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:11.140210 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ab28de87-cfb6-42c2-adf1-e3c6ad48d7b8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:11.140667 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ab28de87-cfb6-42c2-adf1-e3c6ad48d7b8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:11.141419 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ab28de87-cfb6-42c2-adf1-e3c6ad48d7b8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:11.141873 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ab28de87-cfb6-42c2-adf1-e3c6ad48d7b8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:11.156120 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-ab28de87-cfb6-42c2-adf1-e3c6ad48d7b8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] HTTP exception thrown: Instance 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 could not be found. Sep 24 03:33:11.156712 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ab28de87-cfb6-42c2-adf1-e3c6ad48d7b8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] Returning 404 to user: Instance 4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:33:11.157536 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ab28de87-cfb6-42c2-adf1-e3c6ad48d7b8 tempest-VolumesNegativeTest-2130134210 tempest-VolumesNegativeTest-2130134210-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704" status: 404 len: 111 microversion: 2.1 time: 0.028654 Sep 24 03:33:11.158133 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 158/309] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:11 2021] GET /compute/v2.1/servers/4d1b5536-1ee4-4d4a-bafa-1c4dd0369704 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:33:11.569034 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-77bf0c2b-c880-4304-baa1-1a80e81580a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:11.569741 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-77bf0c2b-c880-4304-baa1-1a80e81580a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:11.576954 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-77bf0c2b-c880-4304-baa1-1a80e81580a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:11.577400 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-77bf0c2b-c880-4304-baa1-1a80e81580a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:11.578262 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-77bf0c2b-c880-4304-baa1-1a80e81580a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:11.578679 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-77bf0c2b-c880-4304-baa1-1a80e81580a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:11.707041 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-77bf0c2b-c880-4304-baa1-1a80e81580a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:11.714325 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-77bf0c2b-c880-4304-baa1-1a80e81580a6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.149694 Sep 24 03:33:11.715124 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 152/310] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:11 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:11.863905 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1613e10a-7255-43db-8fce-3f5b12c709f9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:11.864985 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1613e10a-7255-43db-8fce-3f5b12c709f9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:11.870852 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1613e10a-7255-43db-8fce-3f5b12c709f9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:11.871299 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1613e10a-7255-43db-8fce-3f5b12c709f9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:11.872063 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1613e10a-7255-43db-8fce-3f5b12c709f9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:11.872487 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1613e10a-7255-43db-8fce-3f5b12c709f9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:11.916340 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f883d201-b6a0-40e0-9946-ce08723c5052 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:11.917429 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f883d201-b6a0-40e0-9946-ce08723c5052 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:11.923332 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f883d201-b6a0-40e0-9946-ce08723c5052 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:11.924295 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f883d201-b6a0-40e0-9946-ce08723c5052 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:11.925051 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f883d201-b6a0-40e0-9946-ce08723c5052 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:11.925481 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f883d201-b6a0-40e0-9946-ce08723c5052 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:11.953656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1613e10a-7255-43db-8fce-3f5b12c709f9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 34386 microversion: 2.1 time: 0.093885 Sep 24 03:33:11.954330 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 159/311] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:11 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 34386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:33:12.015120 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f883d201-b6a0-40e0-9946-ce08723c5052 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 31607 microversion: 2.20 time: 0.102290 Sep 24 03:33:12.019940 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 153/312] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:11 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 31607 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:33:12.605918 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1139360726", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "networks": [{"uuid": "5110320c-18ec-4819-bd21-89a3b96ba32f"}]}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:12.659696 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.network.neutron [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] validate_networks() for [('5110320c-18ec-4819-bd21-89a3b96ba32f', None, None, None, None, None)] {{(pid=109374) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:33:12.732114 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e36d0c36-291f-46eb-9630-2aad2d59bb14 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:12.732969 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e36d0c36-291f-46eb-9630-2aad2d59bb14 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:12.740387 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e36d0c36-291f-46eb-9630-2aad2d59bb14 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:12.740829 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e36d0c36-291f-46eb-9630-2aad2d59bb14 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:12.741648 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e36d0c36-291f-46eb-9630-2aad2d59bb14 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:12.742053 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e36d0c36-291f-46eb-9630-2aad2d59bb14 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:12.933218 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e36d0c36-291f-46eb-9630-2aad2d59bb14 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:12.945886 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e36d0c36-291f-46eb-9630-2aad2d59bb14 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.217662 Sep 24 03:33:12.948647 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 154/313] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:12 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:12.966845 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5688b5bc-a00b-4526-8ed1-74d0df3c68d1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:12.973913 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5688b5bc-a00b-4526-8ed1-74d0df3c68d1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:12.980760 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5688b5bc-a00b-4526-8ed1-74d0df3c68d1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:12.981314 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5688b5bc-a00b-4526-8ed1-74d0df3c68d1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:12.982221 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5688b5bc-a00b-4526-8ed1-74d0df3c68d1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:12.982647 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5688b5bc-a00b-4526-8ed1-74d0df3c68d1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:13.101830 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Flavor limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:33:13.102470 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Image limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:33:13.102948 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Flavor pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:33:13.103353 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Image pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:33:13.103762 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:33:13.106633 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5688b5bc-a00b-4526-8ed1-74d0df3c68d1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 35221 microversion: 2.1 time: 0.143887 Sep 24 03:33:13.107271 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 155/314] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:12 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 35221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:33:13.112898 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e905a92b-9102-4676-8f86-b1efb722fb65 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:13.114120 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e905a92b-9102-4676-8f86-b1efb722fb65 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:13.117085 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:13.117541 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:13.118371 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:13.118801 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:13.122612 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e905a92b-9102-4676-8f86-b1efb722fb65 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:13.123231 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e905a92b-9102-4676-8f86-b1efb722fb65 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:13.124166 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e905a92b-9102-4676-8f86-b1efb722fb65 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:13.124737 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e905a92b-9102-4676-8f86-b1efb722fb65 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:13.137088 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Getting quotas for project d23b942bef2c49778eda908a1dfb6c1f. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:33:13.141516 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Getting quotas for user 239d6babd47248b59250fe40d9955b43 and project d23b942bef2c49778eda908a1dfb6c1f. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:33:13.154282 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Going to run 1 instances... {{(pid=109374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:33:13.157353 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:33:13.204163 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-438943d0-5594-4145-b817-27daf90de08f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602258 Sep 24 03:33:13.205146 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 160/315] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:33:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:33:13.214638 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-456d65a2-fee9-4edb-8705-f42aaa7d58e8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:13.215479 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-456d65a2-fee9-4edb-8705-f42aaa7d58e8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:13.257947 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e905a92b-9102-4676-8f86-b1efb722fb65 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 32508 microversion: 2.20 time: 0.148690 Sep 24 03:33:13.259525 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 156/316] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:13 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 32508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:13.276132 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-456d65a2-fee9-4edb-8705-f42aaa7d58e8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:13.283630 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-456d65a2-fee9-4edb-8705-f42aaa7d58e8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1214 microversion: 2.1 time: 0.072607 Sep 24 03:33:13.284263 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 161/317] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:13 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:13.967188 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-305033be-6df3-4fd4-b06a-078177cf54c8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:13.967913 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-305033be-6df3-4fd4-b06a-078177cf54c8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:13.975646 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-305033be-6df3-4fd4-b06a-078177cf54c8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:13.976082 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-305033be-6df3-4fd4-b06a-078177cf54c8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:13.976833 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-305033be-6df3-4fd4-b06a-078177cf54c8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:13.977255 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-305033be-6df3-4fd4-b06a-078177cf54c8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:14.101680 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-305033be-6df3-4fd4-b06a-078177cf54c8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:14.108938 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-305033be-6df3-4fd4-b06a-078177cf54c8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.147362 Sep 24 03:33:14.109503 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 157/318] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:13 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:14.117992 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4c2ee1c3-348f-4e36-93ef-3fa849e91c56 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:14.119007 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4c2ee1c3-348f-4e36-93ef-3fa849e91c56 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:14.125366 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4c2ee1c3-348f-4e36-93ef-3fa849e91c56 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:14.125854 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4c2ee1c3-348f-4e36-93ef-3fa849e91c56 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:14.126657 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4c2ee1c3-348f-4e36-93ef-3fa849e91c56 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:14.127116 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4c2ee1c3-348f-4e36-93ef-3fa849e91c56 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:14.228473 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4c2ee1c3-348f-4e36-93ef-3fa849e91c56 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 36158 microversion: 2.1 time: 0.114195 Sep 24 03:33:14.232570 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 162/319] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:14 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 36158 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:33:14.271168 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-21fb4fd7-f224-450b-99b1-c6885aa630cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:14.272078 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-21fb4fd7-f224-450b-99b1-c6885aa630cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:14.277677 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-21fb4fd7-f224-450b-99b1-c6885aa630cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:14.278147 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-21fb4fd7-f224-450b-99b1-c6885aa630cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:14.278895 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-21fb4fd7-f224-450b-99b1-c6885aa630cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:14.279316 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-21fb4fd7-f224-450b-99b1-c6885aa630cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:14.300603 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-345e87cc-0c33-43f3-b0cd-fb3676eaef06 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:14.301300 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-345e87cc-0c33-43f3-b0cd-fb3676eaef06 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:14.308056 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-345e87cc-0c33-43f3-b0cd-fb3676eaef06 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:14.308499 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-345e87cc-0c33-43f3-b0cd-fb3676eaef06 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:14.309276 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-345e87cc-0c33-43f3-b0cd-fb3676eaef06 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:14.309705 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-345e87cc-0c33-43f3-b0cd-fb3676eaef06 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:14.376888 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-345e87cc-0c33-43f3-b0cd-fb3676eaef06 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:14.385493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-345e87cc-0c33-43f3-b0cd-fb3676eaef06 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1266 microversion: 2.1 time: 0.088880 Sep 24 03:33:14.386100 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 163/320] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:14 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:14.390563 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-182d7a4f-ae2a-43eb-849b-29c498ebd7ac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c80ff931-c723-45e8-b558-76f5c4eca87d"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:14.391642 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-182d7a4f-ae2a-43eb-849b-29c498ebd7ac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:14.397974 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-182d7a4f-ae2a-43eb-849b-29c498ebd7ac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:14.398425 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-182d7a4f-ae2a-43eb-849b-29c498ebd7ac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:14.399232 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-182d7a4f-ae2a-43eb-849b-29c498ebd7ac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:14.399761 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-182d7a4f-ae2a-43eb-849b-29c498ebd7ac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:14.412520 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-21fb4fd7-f224-450b-99b1-c6885aa630cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 32932 microversion: 2.20 time: 0.145403 Sep 24 03:33:14.413169 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 158/321] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:14 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 32932 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:14.485661 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-182d7a4f-ae2a-43eb-849b-29c498ebd7ac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] HTTP exception thrown: Invalid volume: volume c80ff931-c723-45e8-b558-76f5c4eca87d is already attached to instances: d7e63e97-71b1-48b6-af18-ea2f33d55dd3 Sep 24 03:33:14.486938 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-182d7a4f-ae2a-43eb-849b-29c498ebd7ac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Returning 400 to user: Invalid volume: volume c80ff931-c723-45e8-b558-76f5c4eca87d is already attached to instances: d7e63e97-71b1-48b6-af18-ea2f33d55dd3 {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:33:14.488112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-182d7a4f-ae2a-43eb-849b-29c498ebd7ac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "POST /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101065 Sep 24 03:33:14.488880 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 164/322] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:33:14 2021] POST /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 03:33:14.560686 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e281a199-12d5-4f1e-801c-9cff5ae016a0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:14.561264 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e281a199-12d5-4f1e-801c-9cff5ae016a0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:14.568445 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e281a199-12d5-4f1e-801c-9cff5ae016a0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:14.568888 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e281a199-12d5-4f1e-801c-9cff5ae016a0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:14.569857 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e281a199-12d5-4f1e-801c-9cff5ae016a0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:14.570450 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e281a199-12d5-4f1e-801c-9cff5ae016a0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:14.661429 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-e281a199-12d5-4f1e-801c-9cff5ae016a0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lazy-loading 'services' on Instance uuid d7e63e97-71b1-48b6-af18-ea2f33d55dd3 {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:33:14.728037 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e281a199-12d5-4f1e-801c-9cff5ae016a0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3/os-volume_attachments/c80ff931-c723-45e8-b558-76f5c4eca87d" status: 202 len: 0 microversion: 2.1 time: 0.171250 Sep 24 03:33:14.728799 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 159/323] 10.222.0.18 () {58 vars in 1416 bytes} [Fri Sep 24 03:33:14 2021] DELETE /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3/os-volume_attachments/c80ff931-c723-45e8-b558-76f5c4eca87d => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:14.736847 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-aadcf219-2d95-4bc1-8e74-b42d5ec1afac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:14.737868 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-aadcf219-2d95-4bc1-8e74-b42d5ec1afac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:14.746924 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aadcf219-2d95-4bc1-8e74-b42d5ec1afac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:14.747515 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aadcf219-2d95-4bc1-8e74-b42d5ec1afac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:14.748418 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aadcf219-2d95-4bc1-8e74-b42d5ec1afac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:14.748761 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aadcf219-2d95-4bc1-8e74-b42d5ec1afac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:14.786622 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-aadcf219-2d95-4bc1-8e74-b42d5ec1afac tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053560 Sep 24 03:33:14.790432 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 165/324] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:33:14 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:33:15.127211 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e24adb83-c740-401f-a7c5-e3240d9d693a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:15.128028 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e24adb83-c740-401f-a7c5-e3240d9d693a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:15.134422 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e24adb83-c740-401f-a7c5-e3240d9d693a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:15.135374 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e24adb83-c740-401f-a7c5-e3240d9d693a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:15.135903 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e24adb83-c740-401f-a7c5-e3240d9d693a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:15.136414 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e24adb83-c740-401f-a7c5-e3240d9d693a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:15.242315 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-eb887c4d-f7d2-4b45-8c46-1e7c54763544 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:15.243703 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-eb887c4d-f7d2-4b45-8c46-1e7c54763544 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:15.251454 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-eb887c4d-f7d2-4b45-8c46-1e7c54763544 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:15.253078 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-eb887c4d-f7d2-4b45-8c46-1e7c54763544 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:15.254268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-eb887c4d-f7d2-4b45-8c46-1e7c54763544 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:15.254919 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-eb887c4d-f7d2-4b45-8c46-1e7c54763544 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:15.315774 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e24adb83-c740-401f-a7c5-e3240d9d693a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:15.324080 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e24adb83-c740-401f-a7c5-e3240d9d693a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.201339 Sep 24 03:33:15.335692 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 160/325] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:15 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:15.373113 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-eb887c4d-f7d2-4b45-8c46-1e7c54763544 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 36929 microversion: 2.1 time: 0.136551 Sep 24 03:33:15.373780 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 166/326] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:15 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 36929 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:33:15.409786 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-be395b24-96d7-40a9-be6d-ede0c56fd4ae tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:15.410710 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-be395b24-96d7-40a9-be6d-ede0c56fd4ae tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:15.418275 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-be395b24-96d7-40a9-be6d-ede0c56fd4ae tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:15.418903 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-be395b24-96d7-40a9-be6d-ede0c56fd4ae tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:15.426210 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2fccb30e-a6e2-423d-9ce7-fe6a86cb9a02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:15.426720 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-be395b24-96d7-40a9-be6d-ede0c56fd4ae tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:15.427171 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-be395b24-96d7-40a9-be6d-ede0c56fd4ae tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:15.427731 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2fccb30e-a6e2-423d-9ce7-fe6a86cb9a02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:15.436235 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2fccb30e-a6e2-423d-9ce7-fe6a86cb9a02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:15.436703 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2fccb30e-a6e2-423d-9ce7-fe6a86cb9a02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:15.437612 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2fccb30e-a6e2-423d-9ce7-fe6a86cb9a02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:15.438159 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2fccb30e-a6e2-423d-9ce7-fe6a86cb9a02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:15.547955 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2fccb30e-a6e2-423d-9ce7-fe6a86cb9a02 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 33367 microversion: 2.20 time: 0.127005 Sep 24 03:33:15.549199 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 167/327] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:15 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 33367 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:15.602090 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-be395b24-96d7-40a9-be6d-ede0c56fd4ae tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:15.609265 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-be395b24-96d7-40a9-be6d-ede0c56fd4ae tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1314 microversion: 2.1 time: 0.203915 Sep 24 03:33:15.611210 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 161/328] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:15 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:15.810195 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6e973e36-ee25-47d1-b87e-75a77ef8d42c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:15.811211 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6e973e36-ee25-47d1-b87e-75a77ef8d42c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:15.815568 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-f92e1d26-3b0f-481b-b390-c5f2db7de3e8 req-fc895e1a-cba3-465e-8e29-df6a6a053739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03c45c1-addf-4994-b5e1-5a74b2661432", "tag": "8a89867b-79de-453d-a062-28755c7fbd4d"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:15.817903 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:33:15.817903 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:33:15.820559 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6e973e36-ee25-47d1-b87e-75a77ef8d42c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:15.821151 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6e973e36-ee25-47d1-b87e-75a77ef8d42c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:15.822003 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6e973e36-ee25-47d1-b87e-75a77ef8d42c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:15.822742 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6e973e36-ee25-47d1-b87e-75a77ef8d42c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:15.828673 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-f92e1d26-3b0f-481b-b390-c5f2db7de3e8 req-fc895e1a-cba3-465e-8e29-df6a6a053739 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:15.828673 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-f92e1d26-3b0f-481b-b390-c5f2db7de3e8 req-fc895e1a-cba3-465e-8e29-df6a6a053739 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:15.843310 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-f92e1d26-3b0f-481b-b390-c5f2db7de3e8 req-fc895e1a-cba3-465e-8e29-df6a6a053739 service nova] Creating event network-changed:8a89867b-79de-453d-a062-28755c7fbd4d for instance d03c45c1-addf-4994-b5e1-5a74b2661432 on hv-cinder-81080 Sep 24 03:33:15.859392 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-f92e1d26-3b0f-481b-b390-c5f2db7de3e8 req-fc895e1a-cba3-465e-8e29-df6a6a053739 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049679 Sep 24 03:33:15.860232 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 162/329] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:33:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:33:15.879795 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6e973e36-ee25-47d1-b87e-75a77ef8d42c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082187 Sep 24 03:33:15.880869 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 168/330] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:33:15 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:33:16.343419 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f4a56f0e-5372-429e-b313-c8e4abaeb234 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:16.344144 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f4a56f0e-5372-429e-b313-c8e4abaeb234 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:16.351528 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f4a56f0e-5372-429e-b313-c8e4abaeb234 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:16.351528 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f4a56f0e-5372-429e-b313-c8e4abaeb234 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:16.352510 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f4a56f0e-5372-429e-b313-c8e4abaeb234 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:16.353181 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f4a56f0e-5372-429e-b313-c8e4abaeb234 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:16.386155 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5ddea41d-9df2-4849-bd54-a25ba17d3894 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:16.387799 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5ddea41d-9df2-4849-bd54-a25ba17d3894 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:16.395839 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5ddea41d-9df2-4849-bd54-a25ba17d3894 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:16.396540 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5ddea41d-9df2-4849-bd54-a25ba17d3894 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:16.397322 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5ddea41d-9df2-4849-bd54-a25ba17d3894 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:16.397778 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5ddea41d-9df2-4849-bd54-a25ba17d3894 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:16.487137 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-f4a56f0e-5372-429e-b313-c8e4abaeb234 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:16.493292 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5ddea41d-9df2-4849-bd54-a25ba17d3894 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 37825 microversion: 2.1 time: 0.110677 Sep 24 03:33:16.505742 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 169/331] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:16 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 37825 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:33:16.505961 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f4a56f0e-5372-429e-b313-c8e4abaeb234 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.156098 Sep 24 03:33:16.505961 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 163/332] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:16 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:16.564444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-26fb2f96-5013-41e1-b279-4ec1245d1ab2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:16.564444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-26fb2f96-5013-41e1-b279-4ec1245d1ab2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:16.571509 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-26fb2f96-5013-41e1-b279-4ec1245d1ab2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:16.571868 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-26fb2f96-5013-41e1-b279-4ec1245d1ab2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:16.572651 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-26fb2f96-5013-41e1-b279-4ec1245d1ab2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:16.573113 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-26fb2f96-5013-41e1-b279-4ec1245d1ab2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:16.628297 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-463303f7-b905-431b-8f9e-e50f98a5a5eb tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:16.628910 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-463303f7-b905-431b-8f9e-e50f98a5a5eb tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:16.635014 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-463303f7-b905-431b-8f9e-e50f98a5a5eb tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:16.635463 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-463303f7-b905-431b-8f9e-e50f98a5a5eb tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:16.636243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-463303f7-b905-431b-8f9e-e50f98a5a5eb tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:16.636674 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-463303f7-b905-431b-8f9e-e50f98a5a5eb tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:16.670689 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-26fb2f96-5013-41e1-b279-4ec1245d1ab2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 33866 microversion: 2.20 time: 0.112738 Sep 24 03:33:16.671692 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 170/333] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:16 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 33866 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:16.766529 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-463303f7-b905-431b-8f9e-e50f98a5a5eb tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:16.774836 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-463303f7-b905-431b-8f9e-e50f98a5a5eb tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1314 microversion: 2.1 time: 0.150228 Sep 24 03:33:16.775470 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 164/334] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:16 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:16.895847 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-fe2d9a18-91fd-47c0-a242-c87353859fd5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:16.897102 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-fe2d9a18-91fd-47c0-a242-c87353859fd5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:16.912798 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fe2d9a18-91fd-47c0-a242-c87353859fd5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:16.914296 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fe2d9a18-91fd-47c0-a242-c87353859fd5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:16.915171 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fe2d9a18-91fd-47c0-a242-c87353859fd5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:16.916464 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fe2d9a18-91fd-47c0-a242-c87353859fd5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:16.960476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-fe2d9a18-91fd-47c0-a242-c87353859fd5 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073243 Sep 24 03:33:16.966923 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 171/335] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:33:16 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:33:17.118897 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-571029734", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "networks": [{"uuid": "da8a83a1-4718-4b4d-b03f-5ba6c433eea0"}]}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:17.182090 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.network.neutron [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] validate_networks() for [('da8a83a1-4718-4b4d-b03f-5ba6c433eea0', None, None, None, None, None)] {{(pid=109375) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:33:17.505226 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-34360b78-3f99-447f-b8ca-ab8a8ecee2fe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:17.506446 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-34360b78-3f99-447f-b8ca-ab8a8ecee2fe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:17.512947 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34360b78-3f99-447f-b8ca-ab8a8ecee2fe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:17.513520 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34360b78-3f99-447f-b8ca-ab8a8ecee2fe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:17.514390 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34360b78-3f99-447f-b8ca-ab8a8ecee2fe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:17.515048 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34360b78-3f99-447f-b8ca-ab8a8ecee2fe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:17.617703 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-34360b78-3f99-447f-b8ca-ab8a8ecee2fe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 38431 microversion: 2.1 time: 0.116638 Sep 24 03:33:17.618410 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 172/336] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:17 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 38431 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:33:17.626323 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0b9f79c0-51ef-469f-8195-8515c3c65b5f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:17.627814 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0b9f79c0-51ef-469f-8195-8515c3c65b5f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:17.634898 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0b9f79c0-51ef-469f-8195-8515c3c65b5f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:17.635585 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0b9f79c0-51ef-469f-8195-8515c3c65b5f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:17.636475 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0b9f79c0-51ef-469f-8195-8515c3c65b5f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:17.637117 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0b9f79c0-51ef-469f-8195-8515c3c65b5f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:18.188654 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0b9f79c0-51ef-469f-8195-8515c3c65b5f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:18.196855 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0b9f79c0-51ef-469f-8195-8515c3c65b5f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.576933 Sep 24 03:33:18.197355 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 173/337] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:17 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:18.201775 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-62deb8b7-c047-454e-92a3-e970c2dd68eb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:18.202657 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-62deb8b7-c047-454e-92a3-e970c2dd68eb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:18.209552 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-62deb8b7-c047-454e-92a3-e970c2dd68eb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:18.210033 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-62deb8b7-c047-454e-92a3-e970c2dd68eb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:18.210795 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-62deb8b7-c047-454e-92a3-e970c2dd68eb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:18.211215 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-62deb8b7-c047-454e-92a3-e970c2dd68eb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:18.234724 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Flavor limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:33:18.235646 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Image limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:33:18.236322 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Flavor pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:33:18.236896 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Image pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:33:18.237492 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:33:18.248681 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:18.249120 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:18.249960 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:18.250387 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:18.267140 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Getting quotas for project cad76815db3c4a67adf42217edb51d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:33:18.271901 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Getting quotas for user 332a6e416a1347d8927b2d48cc37ac37 and project cad76815db3c4a67adf42217edb51d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:33:18.282498 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Going to run 1 instances... {{(pid=109375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:33:18.285192 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:33:18.302941 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-62deb8b7-c047-454e-92a3-e970c2dd68eb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 35092 microversion: 2.20 time: 0.104241 Sep 24 03:33:18.303588 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 174/338] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:18 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 35092 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:18.308707 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e858a32b-3664-4317-aad4-519960e22439 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:18.309801 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e858a32b-3664-4317-aad4-519960e22439 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:18.317976 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e858a32b-3664-4317-aad4-519960e22439 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:18.318665 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e858a32b-3664-4317-aad4-519960e22439 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:18.319617 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e858a32b-3664-4317-aad4-519960e22439 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:18.320118 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e858a32b-3664-4317-aad4-519960e22439 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:18.350327 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-da9c7f55-823a-4131-b732-3ee8d42373b9 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.235741 Sep 24 03:33:18.353821 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 165/339] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:33:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:33:18.362052 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9893e9b7-9ddc-4538-9199-ea5c81305eab tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:18.362665 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9893e9b7-9ddc-4538-9199-ea5c81305eab tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:18.445630 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9893e9b7-9ddc-4538-9199-ea5c81305eab tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:18.454379 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9893e9b7-9ddc-4538-9199-ea5c81305eab tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1217 microversion: 2.1 time: 0.095908 Sep 24 03:33:18.463852 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 166/340] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:18 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:18.603277 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e858a32b-3664-4317-aad4-519960e22439 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:18.613192 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e858a32b-3664-4317-aad4-519960e22439 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1314 microversion: 2.1 time: 0.307491 Sep 24 03:33:18.613548 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 175/341] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:18 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:18.634091 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8747ade0-3a19-46d7-8898-3959647f1d22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:18.635691 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8747ade0-3a19-46d7-8898-3959647f1d22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:18.643713 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8747ade0-3a19-46d7-8898-3959647f1d22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:18.644161 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8747ade0-3a19-46d7-8898-3959647f1d22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:18.644939 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8747ade0-3a19-46d7-8898-3959647f1d22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:18.645695 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8747ade0-3a19-46d7-8898-3959647f1d22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:18.746054 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8747ade0-3a19-46d7-8898-3959647f1d22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 38471 microversion: 2.1 time: 0.119456 Sep 24 03:33:18.747598 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 167/342] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:18 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 38471 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:33:19.216286 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2a90043b-9b19-4b59-9120-568667223d6e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:19.217314 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2a90043b-9b19-4b59-9120-568667223d6e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:19.224971 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a90043b-9b19-4b59-9120-568667223d6e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:19.225332 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a90043b-9b19-4b59-9120-568667223d6e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:19.226493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a90043b-9b19-4b59-9120-568667223d6e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:19.226937 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a90043b-9b19-4b59-9120-568667223d6e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:19.316387 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8a3a3106-59ea-4f7a-ab55-455e3fac38be tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:19.318491 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8a3a3106-59ea-4f7a-ab55-455e3fac38be tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:19.324831 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8a3a3106-59ea-4f7a-ab55-455e3fac38be tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:19.325272 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8a3a3106-59ea-4f7a-ab55-455e3fac38be tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:19.326058 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8a3a3106-59ea-4f7a-ab55-455e3fac38be tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:19.326483 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8a3a3106-59ea-4f7a-ab55-455e3fac38be tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:19.384407 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2a90043b-9b19-4b59-9120-568667223d6e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:19.393364 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2a90043b-9b19-4b59-9120-568667223d6e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.182187 Sep 24 03:33:19.394104 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 176/343] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:19 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:19.422839 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8a3a3106-59ea-4f7a-ab55-455e3fac38be tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 35904 microversion: 2.20 time: 0.111067 Sep 24 03:33:19.423793 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 168/344] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:19 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 35904 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:33:19.473125 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-df7ab362-f403-452f-9eaa-61a52ef8a81a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:19.474397 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-df7ab362-f403-452f-9eaa-61a52ef8a81a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:19.480896 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-df7ab362-f403-452f-9eaa-61a52ef8a81a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:19.481527 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-df7ab362-f403-452f-9eaa-61a52ef8a81a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:19.482742 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-df7ab362-f403-452f-9eaa-61a52ef8a81a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:19.483235 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-df7ab362-f403-452f-9eaa-61a52ef8a81a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:19.604505 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-df7ab362-f403-452f-9eaa-61a52ef8a81a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:19.612552 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-df7ab362-f403-452f-9eaa-61a52ef8a81a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1277 microversion: 2.1 time: 0.144726 Sep 24 03:33:19.613321 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 177/345] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:19 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1277 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:19.632951 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2fd7642b-3a2e-4ace-9b8d-88031c840500 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:19.633655 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2fd7642b-3a2e-4ace-9b8d-88031c840500 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:19.644820 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2fd7642b-3a2e-4ace-9b8d-88031c840500 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:19.648769 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2fd7642b-3a2e-4ace-9b8d-88031c840500 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:19.650674 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2fd7642b-3a2e-4ace-9b8d-88031c840500 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:19.652049 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2fd7642b-3a2e-4ace-9b8d-88031c840500 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:19.760241 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e8618764-51ac-47af-9bce-ffc14392c162 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:19.761680 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e8618764-51ac-47af-9bce-ffc14392c162 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:19.769276 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8618764-51ac-47af-9bce-ffc14392c162 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:19.770009 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8618764-51ac-47af-9bce-ffc14392c162 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:19.771167 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8618764-51ac-47af-9bce-ffc14392c162 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:19.771740 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8618764-51ac-47af-9bce-ffc14392c162 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:19.877129 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e8618764-51ac-47af-9bce-ffc14392c162 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 200 len: 38596 microversion: 2.1 time: 0.120579 Sep 24 03:33:19.878212 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 178/346] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:19 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 38596 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:33:19.881946 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2fd7642b-3a2e-4ace-9b8d-88031c840500 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:19.889829 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e974aaf2-0c24-4e6b-b3ad-b7bf299ce445 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:19.893063 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e974aaf2-0c24-4e6b-b3ad-b7bf299ce445 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:19.903312 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2fd7642b-3a2e-4ace-9b8d-88031c840500 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1314 microversion: 2.1 time: 0.275204 Sep 24 03:33:19.905499 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 169/347] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:19 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:19.918538 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e974aaf2-0c24-4e6b-b3ad-b7bf299ce445 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:19.918991 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e974aaf2-0c24-4e6b-b3ad-b7bf299ce445 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:19.919988 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e974aaf2-0c24-4e6b-b3ad-b7bf299ce445 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:19.920511 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e974aaf2-0c24-4e6b-b3ad-b7bf299ce445 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:19.951425 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e974aaf2-0c24-4e6b-b3ad-b7bf299ce445 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/ips" status: 200 len: 146 microversion: 2.1 time: 0.066827 Sep 24 03:33:19.952916 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 179/348] 10.222.0.18 () {58 vars in 1248 bytes} [Fri Sep 24 03:33:19 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/ips => generated 146 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:33:20.410490 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d2efb50f-9856-4551-a664-16785eb2e322 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:20.411078 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d2efb50f-9856-4551-a664-16785eb2e322 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:20.435885 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-30e89f43-8607-4a83-8b54-7b107551b9dd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:20.436802 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-30e89f43-8607-4a83-8b54-7b107551b9dd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:20.438470 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d2efb50f-9856-4551-a664-16785eb2e322 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:20.446085 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30e89f43-8607-4a83-8b54-7b107551b9dd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:20.446531 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30e89f43-8607-4a83-8b54-7b107551b9dd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:20.447344 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30e89f43-8607-4a83-8b54-7b107551b9dd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:20.447735 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30e89f43-8607-4a83-8b54-7b107551b9dd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:20.449831 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d2efb50f-9856-4551-a664-16785eb2e322 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:20.450811 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d2efb50f-9856-4551-a664-16785eb2e322 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:20.451266 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d2efb50f-9856-4551-a664-16785eb2e322 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:20.611581 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-30e89f43-8607-4a83-8b54-7b107551b9dd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 36952 microversion: 2.20 time: 0.179068 Sep 24 03:33:20.613591 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 180/349] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:20 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 36952 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:33:20.633532 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1afe958e-c6d3-4707-b861-3a2b0dbe7279 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:20.635704 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1afe958e-c6d3-4707-b861-3a2b0dbe7279 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:20.655377 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1afe958e-c6d3-4707-b861-3a2b0dbe7279 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:20.666698 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1afe958e-c6d3-4707-b861-3a2b0dbe7279 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:20.667627 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1afe958e-c6d3-4707-b861-3a2b0dbe7279 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:20.669936 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1afe958e-c6d3-4707-b861-3a2b0dbe7279 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:20.846459 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d2efb50f-9856-4551-a664-16785eb2e322 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:20.860457 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d2efb50f-9856-4551-a664-16785eb2e322 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.454244 Sep 24 03:33:20.868926 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 170/350] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:20 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:20.925670 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-618882fd-4c7e-4864-a0c5-e844a1a5141f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:20.926653 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-618882fd-4c7e-4864-a0c5-e844a1a5141f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:20.936131 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-618882fd-4c7e-4864-a0c5-e844a1a5141f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:20.936596 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-618882fd-4c7e-4864-a0c5-e844a1a5141f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:20.937386 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-618882fd-4c7e-4864-a0c5-e844a1a5141f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:20.937843 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-618882fd-4c7e-4864-a0c5-e844a1a5141f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:21.164166 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1afe958e-c6d3-4707-b861-3a2b0dbe7279 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:21.174969 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1afe958e-c6d3-4707-b861-3a2b0dbe7279 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1317 microversion: 2.1 time: 0.548228 Sep 24 03:33:21.175788 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 181/351] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:20 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:21.302156 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-618882fd-4c7e-4864-a0c5-e844a1a5141f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:21.311976 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-618882fd-4c7e-4864-a0c5-e844a1a5141f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1314 microversion: 2.1 time: 0.392412 Sep 24 03:33:21.312553 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 171/352] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:20 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:21.382296 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-b282a928-5ab4-4003-a699-814a15a9b715 req-ad1d4d17-8536-4c10-bfba-1fec0a1ee2bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc", "tag": "8a7ce87c-b9c1-4dd8-afc3-2ac8f3a08d7e"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:21.383910 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:33:21.383910 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:33:21.402449 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-b282a928-5ab4-4003-a699-814a15a9b715 req-ad1d4d17-8536-4c10-bfba-1fec0a1ee2bd service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:21.402879 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-b282a928-5ab4-4003-a699-814a15a9b715 req-ad1d4d17-8536-4c10-bfba-1fec0a1ee2bd service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:21.417380 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-b282a928-5ab4-4003-a699-814a15a9b715 req-ad1d4d17-8536-4c10-bfba-1fec0a1ee2bd service nova] Creating event network-changed:8a7ce87c-b9c1-4dd8-afc3-2ac8f3a08d7e for instance e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc on hv-cinder-81080 Sep 24 03:33:21.422783 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-b282a928-5ab4-4003-a699-814a15a9b715 req-ad1d4d17-8536-4c10-bfba-1fec0a1ee2bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044370 Sep 24 03:33:21.424055 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 182/353] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:33:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:33:21.625118 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9af99bc1-c9fc-4935-8d1f-53fdad32a77d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:21.626067 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9af99bc1-c9fc-4935-8d1f-53fdad32a77d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:21.640949 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9af99bc1-c9fc-4935-8d1f-53fdad32a77d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:21.642867 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9af99bc1-c9fc-4935-8d1f-53fdad32a77d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:21.643693 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9af99bc1-c9fc-4935-8d1f-53fdad32a77d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:21.644134 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9af99bc1-c9fc-4935-8d1f-53fdad32a77d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:21.817491 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9af99bc1-c9fc-4935-8d1f-53fdad32a77d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 37812 microversion: 2.20 time: 0.195875 Sep 24 03:33:21.818696 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 172/354] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:21 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 37812 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:21.885119 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-27fa324b-a463-490b-82be-7b048fa96485 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:21.886420 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-27fa324b-a463-490b-82be-7b048fa96485 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:21.896573 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-27fa324b-a463-490b-82be-7b048fa96485 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:21.899692 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-27fa324b-a463-490b-82be-7b048fa96485 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:21.901599 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-27fa324b-a463-490b-82be-7b048fa96485 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:21.904999 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-27fa324b-a463-490b-82be-7b048fa96485 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:22.138113 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-27fa324b-a463-490b-82be-7b048fa96485 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:22.152679 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-27fa324b-a463-490b-82be-7b048fa96485 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.271427 Sep 24 03:33:22.153705 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 183/355] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:21 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:22.193363 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2e3fc6bc-b01f-404d-9f1b-29b1f054c693 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:22.194087 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2e3fc6bc-b01f-404d-9f1b-29b1f054c693 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:22.200508 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2e3fc6bc-b01f-404d-9f1b-29b1f054c693 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:22.200953 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2e3fc6bc-b01f-404d-9f1b-29b1f054c693 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:22.201751 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2e3fc6bc-b01f-404d-9f1b-29b1f054c693 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:22.202246 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2e3fc6bc-b01f-404d-9f1b-29b1f054c693 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:22.329250 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f7905b84-deb3-494f-9b58-062476be634b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:22.330421 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f7905b84-deb3-494f-9b58-062476be634b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:22.337798 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f7905b84-deb3-494f-9b58-062476be634b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:22.338541 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f7905b84-deb3-494f-9b58-062476be634b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:22.339502 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f7905b84-deb3-494f-9b58-062476be634b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:22.340106 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f7905b84-deb3-494f-9b58-062476be634b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:22.358431 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2e3fc6bc-b01f-404d-9f1b-29b1f054c693 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:22.368830 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2e3fc6bc-b01f-404d-9f1b-29b1f054c693 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1317 microversion: 2.1 time: 0.180175 Sep 24 03:33:22.378744 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 173/356] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:22 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:22.490845 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-f7905b84-deb3-494f-9b58-062476be634b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:22.499115 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f7905b84-deb3-494f-9b58-062476be634b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1314 microversion: 2.1 time: 0.173489 Sep 24 03:33:22.499688 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 184/357] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:22 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:22.731104 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2e845d48-c157-4eaa-a5cf-4f529318cc55 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0a3b693-528d-4c45-b1b7-278ee403cdb3"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:22.732318 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2e845d48-c157-4eaa-a5cf-4f529318cc55 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:22.739541 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2e845d48-c157-4eaa-a5cf-4f529318cc55 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:22.739982 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2e845d48-c157-4eaa-a5cf-4f529318cc55 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:22.740998 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2e845d48-c157-4eaa-a5cf-4f529318cc55 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:22.741637 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2e845d48-c157-4eaa-a5cf-4f529318cc55 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:22.830938 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a43926b8-89f9-4f9f-bf97-ef2c3e750a9b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:22.832287 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a43926b8-89f9-4f9f-bf97-ef2c3e750a9b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:22.839166 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a43926b8-89f9-4f9f-bf97-ef2c3e750a9b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:22.839607 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a43926b8-89f9-4f9f-bf97-ef2c3e750a9b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:22.840734 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a43926b8-89f9-4f9f-bf97-ef2c3e750a9b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:22.841351 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a43926b8-89f9-4f9f-bf97-ef2c3e750a9b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:22.944652 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a43926b8-89f9-4f9f-bf97-ef2c3e750a9b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 38150 microversion: 2.20 time: 0.118640 Sep 24 03:33:22.946299 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 185/358] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:22 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 38150 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:33:23.036674 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2e845d48-c157-4eaa-a5cf-4f529318cc55 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309604 Sep 24 03:33:23.037303 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 174/359] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:33:22 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:33:23.170648 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e0ea7cbe-cc52-4b2b-ab12-4de1bbd65fd4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:23.171445 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e0ea7cbe-cc52-4b2b-ab12-4de1bbd65fd4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:23.179346 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e0ea7cbe-cc52-4b2b-ab12-4de1bbd65fd4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:23.180096 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e0ea7cbe-cc52-4b2b-ab12-4de1bbd65fd4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:23.181069 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e0ea7cbe-cc52-4b2b-ab12-4de1bbd65fd4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:23.181683 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e0ea7cbe-cc52-4b2b-ab12-4de1bbd65fd4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:23.379348 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e0ea7cbe-cc52-4b2b-ab12-4de1bbd65fd4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:23.388206 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e0ea7cbe-cc52-4b2b-ab12-4de1bbd65fd4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.222327 Sep 24 03:33:23.390003 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ee91570b-442f-4276-bbb1-baeeb6618847 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:23.390997 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ee91570b-442f-4276-bbb1-baeeb6618847 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:23.399454 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ee91570b-442f-4276-bbb1-baeeb6618847 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:23.400261 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ee91570b-442f-4276-bbb1-baeeb6618847 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:23.400703 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 186/360] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:23 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:23.401543 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ee91570b-442f-4276-bbb1-baeeb6618847 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:23.402415 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ee91570b-442f-4276-bbb1-baeeb6618847 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:23.521154 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-564214f3-2891-4286-8776-5ef1a37adbd9 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:23.522416 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-564214f3-2891-4286-8776-5ef1a37adbd9 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:23.547499 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-564214f3-2891-4286-8776-5ef1a37adbd9 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:23.548166 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-564214f3-2891-4286-8776-5ef1a37adbd9 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:23.550269 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-564214f3-2891-4286-8776-5ef1a37adbd9 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:23.551890 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-564214f3-2891-4286-8776-5ef1a37adbd9 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:23.561639 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ee91570b-442f-4276-bbb1-baeeb6618847 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:23.569586 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ee91570b-442f-4276-bbb1-baeeb6618847 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1317 microversion: 2.1 time: 0.186783 Sep 24 03:33:23.580562 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 175/361] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:23 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:23.707501 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-564214f3-2891-4286-8776-5ef1a37adbd9 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:23.716073 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-564214f3-2891-4286-8776-5ef1a37adbd9 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1314 microversion: 2.1 time: 0.204596 Sep 24 03:33:23.716654 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 187/362] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:23 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:23.957848 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ad07bc46-a941-4ed5-9a8d-bf4b1e0ff5cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:23.959353 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ad07bc46-a941-4ed5-9a8d-bf4b1e0ff5cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:23.966587 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad07bc46-a941-4ed5-9a8d-bf4b1e0ff5cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:23.967244 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad07bc46-a941-4ed5-9a8d-bf4b1e0ff5cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:23.968608 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad07bc46-a941-4ed5-9a8d-bf4b1e0ff5cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:23.969308 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad07bc46-a941-4ed5-9a8d-bf4b1e0ff5cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:24.047923 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ad07bc46-a941-4ed5-9a8d-bf4b1e0ff5cd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 38150 microversion: 2.20 time: 0.093639 Sep 24 03:33:24.050071 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 176/363] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:23 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 38150 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:24.405741 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2acaad1a-00cc-4a72-8eec-3c825c1764e5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:24.406368 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2acaad1a-00cc-4a72-8eec-3c825c1764e5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:24.415846 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2acaad1a-00cc-4a72-8eec-3c825c1764e5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:24.417959 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2acaad1a-00cc-4a72-8eec-3c825c1764e5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:24.419582 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2acaad1a-00cc-4a72-8eec-3c825c1764e5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:24.421350 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2acaad1a-00cc-4a72-8eec-3c825c1764e5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:24.588861 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6a36e9cf-ec10-48f9-9e82-935b56513703 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:24.589667 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6a36e9cf-ec10-48f9-9e82-935b56513703 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:24.596685 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6a36e9cf-ec10-48f9-9e82-935b56513703 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:24.597582 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6a36e9cf-ec10-48f9-9e82-935b56513703 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:24.598582 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6a36e9cf-ec10-48f9-9e82-935b56513703 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:24.599235 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6a36e9cf-ec10-48f9-9e82-935b56513703 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:24.692683 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2acaad1a-00cc-4a72-8eec-3c825c1764e5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:24.701650 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2acaad1a-00cc-4a72-8eec-3c825c1764e5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.299574 Sep 24 03:33:24.702752 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 188/364] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:24 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:24.732401 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6bd51156-a393-48e4-8861-33c1af555ab5 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:24.733003 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6bd51156-a393-48e4-8861-33c1af555ab5 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:24.742056 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6bd51156-a393-48e4-8861-33c1af555ab5 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:24.742504 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6bd51156-a393-48e4-8861-33c1af555ab5 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:24.743794 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6bd51156-a393-48e4-8861-33c1af555ab5 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:24.744235 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6bd51156-a393-48e4-8861-33c1af555ab5 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:24.951631 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6a36e9cf-ec10-48f9-9e82-935b56513703 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:24.961517 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6a36e9cf-ec10-48f9-9e82-935b56513703 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1317 microversion: 2.1 time: 0.377102 Sep 24 03:33:24.962555 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 177/365] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:24 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:25.061127 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b4e2428a-5ba3-45b9-8c08-4c370e02cfcd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:25.062080 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b4e2428a-5ba3-45b9-8c08-4c370e02cfcd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:25.069194 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b4e2428a-5ba3-45b9-8c08-4c370e02cfcd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:25.069955 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b4e2428a-5ba3-45b9-8c08-4c370e02cfcd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:25.070893 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b4e2428a-5ba3-45b9-8c08-4c370e02cfcd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:25.071472 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b4e2428a-5ba3-45b9-8c08-4c370e02cfcd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:25.082227 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6bd51156-a393-48e4-8861-33c1af555ab5 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:25.091288 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6bd51156-a393-48e4-8861-33c1af555ab5 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1314 microversion: 2.1 time: 0.362696 Sep 24 03:33:25.091869 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 189/366] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:24 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:25.191843 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b4e2428a-5ba3-45b9-8c08-4c370e02cfcd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 200 len: 38292 microversion: 2.20 time: 0.134393 Sep 24 03:33:25.205092 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 178/367] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:25 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 38292 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:33:25.209449 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3e689f51-97cd-474f-ad42-fc6e1d7a5fde tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:25.210299 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3e689f51-97cd-474f-ad42-fc6e1d7a5fde tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:25.217314 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3e689f51-97cd-474f-ad42-fc6e1d7a5fde tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:25.217766 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3e689f51-97cd-474f-ad42-fc6e1d7a5fde tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:25.218551 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3e689f51-97cd-474f-ad42-fc6e1d7a5fde tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:25.218966 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3e689f51-97cd-474f-ad42-fc6e1d7a5fde tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:25.285996 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3e689f51-97cd-474f-ad42-fc6e1d7a5fde tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/ips" status: 200 len: 149 microversion: 2.20 time: 0.081074 Sep 24 03:33:25.288364 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 190/368] 10.222.0.18 () {60 vars in 1289 bytes} [Fri Sep 24 03:33:25 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/ips => generated 149 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:33:25.348439 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-e80b2bfc-8e2f-4bd1-9ec2-11d58b46bb3c req-4171bb1b-7403-4a15-b6b7-0a5e6077c532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03c45c1-addf-4994-b5e1-5a74b2661432", "name": "network-vif-plugged", "status": "completed", "tag": "8a89867b-79de-453d-a062-28755c7fbd4d"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:25.350066 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:33:25.350066 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:33:25.359056 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-e80b2bfc-8e2f-4bd1-9ec2-11d58b46bb3c req-4171bb1b-7403-4a15-b6b7-0a5e6077c532 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:25.359578 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-e80b2bfc-8e2f-4bd1-9ec2-11d58b46bb3c req-4171bb1b-7403-4a15-b6b7-0a5e6077c532 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:25.372117 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-e80b2bfc-8e2f-4bd1-9ec2-11d58b46bb3c req-4171bb1b-7403-4a15-b6b7-0a5e6077c532 service nova] Creating event network-vif-plugged:8a89867b-79de-453d-a062-28755c7fbd4d for instance d03c45c1-addf-4994-b5e1-5a74b2661432 on hv-cinder-81080 Sep 24 03:33:25.377998 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-e80b2bfc-8e2f-4bd1-9ec2-11d58b46bb3c req-4171bb1b-7403-4a15-b6b7-0a5e6077c532 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035845 Sep 24 03:33:25.378981 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 179/369] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:33:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:33:25.719404 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-108bd25a-394d-45ec-91d0-08545806b3b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:25.720016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-108bd25a-394d-45ec-91d0-08545806b3b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:25.737272 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-108bd25a-394d-45ec-91d0-08545806b3b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:25.737748 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-108bd25a-394d-45ec-91d0-08545806b3b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:25.738549 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-108bd25a-394d-45ec-91d0-08545806b3b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:25.738983 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-108bd25a-394d-45ec-91d0-08545806b3b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:25.915571 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-108bd25a-394d-45ec-91d0-08545806b3b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:25.932894 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-108bd25a-394d-45ec-91d0-08545806b3b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1501 microversion: 2.1 time: 0.216956 Sep 24 03:33:25.934054 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 191/370] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:25 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1501 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:25.950990 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-491c9896-c076-435f-8cc3-7b78040f1d46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30e4e253-dfb1-4925-9f31-5656cee1499b"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:25.952522 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-491c9896-c076-435f-8cc3-7b78040f1d46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:25.960262 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-491c9896-c076-435f-8cc3-7b78040f1d46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:25.960912 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-491c9896-c076-435f-8cc3-7b78040f1d46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:25.962060 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-491c9896-c076-435f-8cc3-7b78040f1d46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:25.963075 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-491c9896-c076-435f-8cc3-7b78040f1d46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:25.978050 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d75ce4f1-3c4b-497e-834a-a4305f71045c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:25.979131 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d75ce4f1-3c4b-497e-834a-a4305f71045c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:25.987708 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d75ce4f1-3c4b-497e-834a-a4305f71045c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:25.989900 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d75ce4f1-3c4b-497e-834a-a4305f71045c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:25.990876 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d75ce4f1-3c4b-497e-834a-a4305f71045c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:25.996779 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d75ce4f1-3c4b-497e-834a-a4305f71045c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:26.001659 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-491c9896-c076-435f-8cc3-7b78040f1d46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] HTTP exception thrown: Cannot 'attach_volume' instance 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 while it is in vm_state rescued Sep 24 03:33:26.005241 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-491c9896-c076-435f-8cc3-7b78040f1d46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Returning 409 to user: Cannot 'attach_volume' instance 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 while it is in vm_state rescued {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:33:26.006455 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-491c9896-c076-435f-8cc3-7b78040f1d46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "POST /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059958 Sep 24 03:33:26.007866 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 180/371] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:33:25 2021] POST /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 24 03:33:26.016663 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5b9f145a-a637-4acb-853b-87b593d129b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:26.018082 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5b9f145a-a637-4acb-853b-87b593d129b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:26.024442 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5b9f145a-a637-4acb-853b-87b593d129b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:26.025248 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5b9f145a-a637-4acb-853b-87b593d129b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:26.026264 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5b9f145a-a637-4acb-853b-87b593d129b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:26.026854 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5b9f145a-a637-4acb-853b-87b593d129b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:26.167188 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5b9f145a-a637-4acb-853b-87b593d129b8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "POST /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/action" status: 202 len: 0 microversion: 2.1 time: 0.154349 Sep 24 03:33:26.171901 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 181/372] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:26 2021] POST /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:26.193820 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-662cf04b-1767-47f2-bfee-0a9e1d2e271a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:26.194666 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-662cf04b-1767-47f2-bfee-0a9e1d2e271a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:26.212364 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-662cf04b-1767-47f2-bfee-0a9e1d2e271a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:26.226159 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-662cf04b-1767-47f2-bfee-0a9e1d2e271a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:26.231770 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-662cf04b-1767-47f2-bfee-0a9e1d2e271a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:26.232395 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-662cf04b-1767-47f2-bfee-0a9e1d2e271a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:26.278225 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d75ce4f1-3c4b-497e-834a-a4305f71045c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:26.286625 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d75ce4f1-3c4b-497e-834a-a4305f71045c tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1317 microversion: 2.1 time: 0.312265 Sep 24 03:33:26.288189 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 192/373] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:25 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:26.301181 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4223f918-4439-4eda-83da-bec90fdb7a8f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:26.302309 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4223f918-4439-4eda-83da-bec90fdb7a8f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:26.316648 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4223f918-4439-4eda-83da-bec90fdb7a8f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:26.317103 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4223f918-4439-4eda-83da-bec90fdb7a8f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:26.317953 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4223f918-4439-4eda-83da-bec90fdb7a8f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:26.318382 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4223f918-4439-4eda-83da-bec90fdb7a8f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:26.687705 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-662cf04b-1767-47f2-bfee-0a9e1d2e271a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:26.698376 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-662cf04b-1767-47f2-bfee-0a9e1d2e271a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1314 microversion: 2.1 time: 0.525043 Sep 24 03:33:26.698977 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 182/374] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:26 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:26.790945 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4223f918-4439-4eda-83da-bec90fdb7a8f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:26.802049 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4223f918-4439-4eda-83da-bec90fdb7a8f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1509 microversion: 2.1 time: 0.509795 Sep 24 03:33:26.804830 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 193/375] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:26 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1509 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:27.304603 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c1fd5ed1-9f17-46b8-a36a-49428d2a02e2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:27.305212 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c1fd5ed1-9f17-46b8-a36a-49428d2a02e2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:27.316365 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c1fd5ed1-9f17-46b8-a36a-49428d2a02e2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:27.317097 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c1fd5ed1-9f17-46b8-a36a-49428d2a02e2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:27.319229 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c1fd5ed1-9f17-46b8-a36a-49428d2a02e2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:27.325131 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c1fd5ed1-9f17-46b8-a36a-49428d2a02e2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:27.599429 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c1fd5ed1-9f17-46b8-a36a-49428d2a02e2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:27.607706 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c1fd5ed1-9f17-46b8-a36a-49428d2a02e2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1317 microversion: 2.1 time: 0.306737 Sep 24 03:33:27.608290 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 183/376] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:27 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:27.716113 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-66a7ca44-b939-41f8-8026-ed278accec9e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:27.716731 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-66a7ca44-b939-41f8-8026-ed278accec9e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:27.734781 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-66a7ca44-b939-41f8-8026-ed278accec9e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:27.738454 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-66a7ca44-b939-41f8-8026-ed278accec9e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:27.741742 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-66a7ca44-b939-41f8-8026-ed278accec9e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:27.742289 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-66a7ca44-b939-41f8-8026-ed278accec9e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:27.826210 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9438493c-41f1-4dd5-97d4-dfe6c8b1f5f4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:27.826852 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9438493c-41f1-4dd5-97d4-dfe6c8b1f5f4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:27.850366 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9438493c-41f1-4dd5-97d4-dfe6c8b1f5f4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:27.854532 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9438493c-41f1-4dd5-97d4-dfe6c8b1f5f4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:27.855731 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9438493c-41f1-4dd5-97d4-dfe6c8b1f5f4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:27.856368 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9438493c-41f1-4dd5-97d4-dfe6c8b1f5f4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:27.995099 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-66a7ca44-b939-41f8-8026-ed278accec9e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:28.004729 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-66a7ca44-b939-41f8-8026-ed278accec9e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1499 microversion: 2.1 time: 0.292221 Sep 24 03:33:28.024914 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 194/377] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:27 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1499 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:28.034685 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-072f8f48-6cf4-4f49-974a-2d318886c562 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:28.040354 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-072f8f48-6cf4-4f49-974a-2d318886c562 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:28.054307 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-072f8f48-6cf4-4f49-974a-2d318886c562 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:28.055437 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-072f8f48-6cf4-4f49-974a-2d318886c562 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:28.056379 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-072f8f48-6cf4-4f49-974a-2d318886c562 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:28.057225 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-072f8f48-6cf4-4f49-974a-2d318886c562 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:28.104882 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.objects.instance [None req-072f8f48-6cf4-4f49-974a-2d318886c562 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lazy-loading 'flavor' on Instance uuid 3f043b14-af6f-4d95-a094-87fa6c768493 {{(pid=109374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:33:28.118394 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9438493c-41f1-4dd5-97d4-dfe6c8b1f5f4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:28.131158 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9438493c-41f1-4dd5-97d4-dfe6c8b1f5f4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1509 microversion: 2.1 time: 0.311720 Sep 24 03:33:28.143114 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 184/378] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:27 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:28.601348 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-072f8f48-6cf4-4f49-974a-2d318886c562 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 202 len: 0 microversion: 2.20 time: 0.570976 Sep 24 03:33:28.612616 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-defa087d-d824-403c-aecd-8bf3eb051550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:28.613246 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-defa087d-d824-403c-aecd-8bf3eb051550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:28.616552 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 195/379] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:33:28 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:33:28.634990 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-defa087d-d824-403c-aecd-8bf3eb051550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:28.638816 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-defa087d-d824-403c-aecd-8bf3eb051550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:28.644452 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-bc6cad82-2fdf-4636-979a-7bfb5c288f35 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:28.644810 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-defa087d-d824-403c-aecd-8bf3eb051550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:28.645994 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-defa087d-d824-403c-aecd-8bf3eb051550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:28.648156 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-bc6cad82-2fdf-4636-979a-7bfb5c288f35 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:28.663259 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bc6cad82-2fdf-4636-979a-7bfb5c288f35 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:28.680452 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bc6cad82-2fdf-4636-979a-7bfb5c288f35 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:28.682612 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bc6cad82-2fdf-4636-979a-7bfb5c288f35 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:28.684493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bc6cad82-2fdf-4636-979a-7bfb5c288f35 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:29.063692 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-defa087d-d824-403c-aecd-8bf3eb051550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:29.073341 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-defa087d-d824-403c-aecd-8bf3eb051550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:29.075126 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-defa087d-d824-403c-aecd-8bf3eb051550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:29.076675 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-defa087d-d824-403c-aecd-8bf3eb051550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.468725 Sep 24 03:33:29.077756 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 185/380] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:28 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:33:29.083592 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-14753792-f708-44d5-8708-3ab4bed7b248 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:29.086671 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-bc6cad82-2fdf-4636-979a-7bfb5c288f35 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:29.097184 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-14753792-f708-44d5-8708-3ab4bed7b248 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:29.098467 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-bc6cad82-2fdf-4636-979a-7bfb5c288f35 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1317 microversion: 2.1 time: 0.476497 Sep 24 03:33:29.101146 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 196/381] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:28 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:29.107517 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-4dec7c8c-28bd-4464-b9a9-78772f5d1532 req-5f64a85c-f838-4582-9008-e6fb660f03c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc", "name": "network-vif-plugged", "status": "completed", "tag": "8a7ce87c-b9c1-4dd8-afc3-2ac8f3a08d7e"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:29.112965 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:33:29.112965 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:33:29.120955 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-4dec7c8c-28bd-4464-b9a9-78772f5d1532 req-5f64a85c-f838-4582-9008-e6fb660f03c9 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:29.122022 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-4dec7c8c-28bd-4464-b9a9-78772f5d1532 req-5f64a85c-f838-4582-9008-e6fb660f03c9 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:29.124008 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-14753792-f708-44d5-8708-3ab4bed7b248 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:29.124473 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-14753792-f708-44d5-8708-3ab4bed7b248 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:29.125297 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-14753792-f708-44d5-8708-3ab4bed7b248 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:29.131476 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-14753792-f708-44d5-8708-3ab4bed7b248 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:29.136318 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-4dec7c8c-28bd-4464-b9a9-78772f5d1532 req-5f64a85c-f838-4582-9008-e6fb660f03c9 service nova] Creating event network-vif-plugged:8a7ce87c-b9c1-4dd8-afc3-2ac8f3a08d7e for instance e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc on hv-cinder-81080 Sep 24 03:33:29.153740 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-4dec7c8c-28bd-4464-b9a9-78772f5d1532 req-5f64a85c-f838-4582-9008-e6fb660f03c9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051069 Sep 24 03:33:29.154886 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 197/382] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:33:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:33:29.161165 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-de0698ca-4c47-4507-a063-b9eb7c4e53e4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:29.162182 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-de0698ca-4c47-4507-a063-b9eb7c4e53e4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:29.170280 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-de0698ca-4c47-4507-a063-b9eb7c4e53e4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:29.172163 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-de0698ca-4c47-4507-a063-b9eb7c4e53e4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:29.174692 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-de0698ca-4c47-4507-a063-b9eb7c4e53e4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:29.175347 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-de0698ca-4c47-4507-a063-b9eb7c4e53e4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:29.185999 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-14753792-f708-44d5-8708-3ab4bed7b248 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Going to try to terminate instance {{(pid=109375) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:33:29.401771 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-de0698ca-4c47-4507-a063-b9eb7c4e53e4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:29.405659 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-14753792-f708-44d5-8708-3ab4bed7b248 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 204 len: 0 microversion: 2.1 time: 0.326493 Sep 24 03:33:29.407125 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 186/383] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:33:29 2021] DELETE /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:33:29.414163 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-de0698ca-4c47-4507-a063-b9eb7c4e53e4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1509 microversion: 2.1 time: 0.257871 Sep 24 03:33:29.414778 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 198/384] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:29 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:29.423075 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-46138790-0dd1-470c-906a-f95eaae446a0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:29.426626 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-46138790-0dd1-470c-906a-f95eaae446a0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:29.435978 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-46138790-0dd1-470c-906a-f95eaae446a0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:29.436592 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-46138790-0dd1-470c-906a-f95eaae446a0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:29.437623 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-46138790-0dd1-470c-906a-f95eaae446a0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:29.438276 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-46138790-0dd1-470c-906a-f95eaae446a0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:29.634228 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-46138790-0dd1-470c-906a-f95eaae446a0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:29.642958 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-46138790-0dd1-470c-906a-f95eaae446a0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1505 microversion: 2.1 time: 0.229638 Sep 24 03:33:29.644124 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 187/385] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:29 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:30.099448 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-fd50f7be-39c4-4a51-9aab-01cc1f5738c6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:30.100042 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-fd50f7be-39c4-4a51-9aab-01cc1f5738c6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:30.106306 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fd50f7be-39c4-4a51-9aab-01cc1f5738c6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:30.106915 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fd50f7be-39c4-4a51-9aab-01cc1f5738c6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:30.107702 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fd50f7be-39c4-4a51-9aab-01cc1f5738c6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:30.108160 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fd50f7be-39c4-4a51-9aab-01cc1f5738c6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:30.123417 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-be4b0acf-908c-4684-b7e7-37549f9529f8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:30.125661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-be4b0acf-908c-4684-b7e7-37549f9529f8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:30.148289 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-be4b0acf-908c-4684-b7e7-37549f9529f8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:30.148834 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-be4b0acf-908c-4684-b7e7-37549f9529f8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:30.149970 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-be4b0acf-908c-4684-b7e7-37549f9529f8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:30.150514 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-be4b0acf-908c-4684-b7e7-37549f9529f8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:30.389861 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-fd50f7be-39c4-4a51-9aab-01cc1f5738c6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:30.402198 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-fd50f7be-39c4-4a51-9aab-01cc1f5738c6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:30.403883 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-fd50f7be-39c4-4a51-9aab-01cc1f5738c6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:30.405088 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-fd50f7be-39c4-4a51-9aab-01cc1f5738c6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.313355 Sep 24 03:33:30.416099 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 199/386] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:30 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:30.448485 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5ae31ea1-19b9-435e-ba18-1e2e5934e89c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:30.450511 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5ae31ea1-19b9-435e-ba18-1e2e5934e89c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:30.463918 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5ae31ea1-19b9-435e-ba18-1e2e5934e89c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:30.464627 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5ae31ea1-19b9-435e-ba18-1e2e5934e89c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:30.466190 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5ae31ea1-19b9-435e-ba18-1e2e5934e89c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:30.468545 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5ae31ea1-19b9-435e-ba18-1e2e5934e89c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:30.502968 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-be4b0acf-908c-4684-b7e7-37549f9529f8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:30.511367 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-be4b0acf-908c-4684-b7e7-37549f9529f8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1317 microversion: 2.1 time: 0.400715 Sep 24 03:33:30.533416 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 188/387] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:30 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:30.662329 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-cc8fb2c9-8b44-40ff-82e0-853ab8bf8341 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:30.663680 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-cc8fb2c9-8b44-40ff-82e0-853ab8bf8341 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:30.672329 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cc8fb2c9-8b44-40ff-82e0-853ab8bf8341 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:30.672768 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cc8fb2c9-8b44-40ff-82e0-853ab8bf8341 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:30.677255 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cc8fb2c9-8b44-40ff-82e0-853ab8bf8341 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:30.677699 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cc8fb2c9-8b44-40ff-82e0-853ab8bf8341 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:30.698034 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5ae31ea1-19b9-435e-ba18-1e2e5934e89c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:30.707517 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5ae31ea1-19b9-435e-ba18-1e2e5934e89c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1515 microversion: 2.1 time: 0.278006 Sep 24 03:33:30.709025 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 200/388] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:30 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:30.940809 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-cc8fb2c9-8b44-40ff-82e0-853ab8bf8341 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:30.951874 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-cc8fb2c9-8b44-40ff-82e0-853ab8bf8341 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1505 microversion: 2.1 time: 0.293994 Sep 24 03:33:30.966325 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 189/389] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:30 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:30.977645 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f234d715-2bf6-449c-b858-9036db00b0cf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:31.031885 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f234d715-2bf6-449c-b858-9036db00b0cf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:31.032399 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f234d715-2bf6-449c-b858-9036db00b0cf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:31.120569 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f234d715-2bf6-449c-b858-9036db00b0cf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Going to try to stop instance {{(pid=109374) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Sep 24 03:33:31.180968 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f234d715-2bf6-449c-b858-9036db00b0cf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 202 len: 0 microversion: 2.1 time: 0.207126 Sep 24 03:33:31.182304 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 201/390] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:30 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:31.191042 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-bf0ccbf2-8fd5-4bbd-9999-b619c39ca128 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:31.191660 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-bf0ccbf2-8fd5-4bbd-9999-b619c39ca128 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:31.199817 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bf0ccbf2-8fd5-4bbd-9999-b619c39ca128 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:31.203645 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bf0ccbf2-8fd5-4bbd-9999-b619c39ca128 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:31.205147 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bf0ccbf2-8fd5-4bbd-9999-b619c39ca128 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:31.205806 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bf0ccbf2-8fd5-4bbd-9999-b619c39ca128 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:31.388658 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-bf0ccbf2-8fd5-4bbd-9999-b619c39ca128 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:31.400337 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-bf0ccbf2-8fd5-4bbd-9999-b619c39ca128 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.213630 Sep 24 03:33:31.401414 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 190/391] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:31 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:31.425052 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8ab6ace7-edf4-4815-ab10-31204279b208 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:31.425663 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8ab6ace7-edf4-4815-ab10-31204279b208 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:31.435933 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8ab6ace7-edf4-4815-ab10-31204279b208 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:31.436955 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8ab6ace7-edf4-4815-ab10-31204279b208 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:31.438112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8ab6ace7-edf4-4815-ab10-31204279b208 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:31.440376 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8ab6ace7-edf4-4815-ab10-31204279b208 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:31.539461 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-91d4ea04-9e45-40b1-80d8-7231f3a50a0e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:31.541149 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-91d4ea04-9e45-40b1-80d8-7231f3a50a0e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:31.568177 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-91d4ea04-9e45-40b1-80d8-7231f3a50a0e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:31.569502 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-91d4ea04-9e45-40b1-80d8-7231f3a50a0e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:31.572362 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-91d4ea04-9e45-40b1-80d8-7231f3a50a0e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:31.573829 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-91d4ea04-9e45-40b1-80d8-7231f3a50a0e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:31.739792 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8ab6ace7-edf4-4815-ab10-31204279b208 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:31.750925 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8ab6ace7-edf4-4815-ab10-31204279b208 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:31.752659 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8ab6ace7-edf4-4815-ab10-31204279b208 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:31.756545 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8ab6ace7-edf4-4815-ab10-31204279b208 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.335389 Sep 24 03:33:31.765973 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 202/392] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:31 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:31.866250 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-91d4ea04-9e45-40b1-80d8-7231f3a50a0e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:31.874871 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-91d4ea04-9e45-40b1-80d8-7231f3a50a0e tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1317 microversion: 2.1 time: 0.340061 Sep 24 03:33:31.877180 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 191/393] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:31 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:31.968225 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5df2b654-7fe7-4bda-b2a4-ec5c94deaaf8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:31.968857 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5df2b654-7fe7-4bda-b2a4-ec5c94deaaf8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:31.976441 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5df2b654-7fe7-4bda-b2a4-ec5c94deaaf8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:31.976947 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5df2b654-7fe7-4bda-b2a4-ec5c94deaaf8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:31.977664 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5df2b654-7fe7-4bda-b2a4-ec5c94deaaf8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:31.978216 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5df2b654-7fe7-4bda-b2a4-ec5c94deaaf8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:32.171135 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5df2b654-7fe7-4bda-b2a4-ec5c94deaaf8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:32.183277 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5df2b654-7fe7-4bda-b2a4-ec5c94deaaf8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1505 microversion: 2.1 time: 0.218662 Sep 24 03:33:32.184589 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 203/394] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:31 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:32.262602 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-caeca443-c1e4-474f-90f7-3629f3eb7c3c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:32.263556 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-caeca443-c1e4-474f-90f7-3629f3eb7c3c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:32.276257 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-caeca443-c1e4-474f-90f7-3629f3eb7c3c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:32.277444 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-caeca443-c1e4-474f-90f7-3629f3eb7c3c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:32.278681 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-caeca443-c1e4-474f-90f7-3629f3eb7c3c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:32.279425 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-caeca443-c1e4-474f-90f7-3629f3eb7c3c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:32.418181 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e6f4108a-3e65-4e74-aa2c-35aff4810bf2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:32.419905 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e6f4108a-3e65-4e74-aa2c-35aff4810bf2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:32.426606 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e6f4108a-3e65-4e74-aa2c-35aff4810bf2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:32.427037 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e6f4108a-3e65-4e74-aa2c-35aff4810bf2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:32.427809 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e6f4108a-3e65-4e74-aa2c-35aff4810bf2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:32.428230 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e6f4108a-3e65-4e74-aa2c-35aff4810bf2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:32.463498 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-caeca443-c1e4-474f-90f7-3629f3eb7c3c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:32.473601 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-caeca443-c1e4-474f-90f7-3629f3eb7c3c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1515 microversion: 2.1 time: 0.215418 Sep 24 03:33:32.474590 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 192/395] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:32 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1515 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:32.491924 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-90d37cdc-c133-4c84-b791-0a1b23dacfa6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d068612-3557-43e2-ba05-9c7fbb4f65e8"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:32.493634 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-90d37cdc-c133-4c84-b791-0a1b23dacfa6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:32.506357 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-90d37cdc-c133-4c84-b791-0a1b23dacfa6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:32.506798 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-90d37cdc-c133-4c84-b791-0a1b23dacfa6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:32.507572 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-90d37cdc-c133-4c84-b791-0a1b23dacfa6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:32.508010 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-90d37cdc-c133-4c84-b791-0a1b23dacfa6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:32.690364 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e6f4108a-3e65-4e74-aa2c-35aff4810bf2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:32.703633 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e6f4108a-3e65-4e74-aa2c-35aff4810bf2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.288960 Sep 24 03:33:32.704828 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 204/396] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:32 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:32.773606 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-cbf83352-23bc-48da-8cf4-456660c789ea tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:32.774344 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-cbf83352-23bc-48da-8cf4-456660c789ea tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:32.786755 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cbf83352-23bc-48da-8cf4-456660c789ea tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:32.789008 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cbf83352-23bc-48da-8cf4-456660c789ea tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:32.790504 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cbf83352-23bc-48da-8cf4-456660c789ea tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:32.792484 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cbf83352-23bc-48da-8cf4-456660c789ea tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:32.962917 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-90d37cdc-c133-4c84-b791-0a1b23dacfa6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "POST /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468204 Sep 24 03:33:32.965856 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 193/397] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:33:32 2021] POST /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:33:33.013899 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3ee540e0-b26d-4048-86c7-36fe4086746f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:33.014644 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3ee540e0-b26d-4048-86c7-36fe4086746f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:33.059996 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ee540e0-b26d-4048-86c7-36fe4086746f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:33.062467 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ee540e0-b26d-4048-86c7-36fe4086746f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:33.065269 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ee540e0-b26d-4048-86c7-36fe4086746f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:33.072791 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ee540e0-b26d-4048-86c7-36fe4086746f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:33.143219 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-cbf83352-23bc-48da-8cf4-456660c789ea tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:33.163709 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-cbf83352-23bc-48da-8cf4-456660c789ea tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:33.165579 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-cbf83352-23bc-48da-8cf4-456660c789ea tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:33.168768 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-cbf83352-23bc-48da-8cf4-456660c789ea tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.398831 Sep 24 03:33:33.170345 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 205/398] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:32 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:33:33.200814 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-78e5d58b-1d35-47d8-97f2-fadfb87df41a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:33.203330 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-78e5d58b-1d35-47d8-97f2-fadfb87df41a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:33.214835 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-78e5d58b-1d35-47d8-97f2-fadfb87df41a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:33.234547 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-78e5d58b-1d35-47d8-97f2-fadfb87df41a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:33.235393 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-78e5d58b-1d35-47d8-97f2-fadfb87df41a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:33.235953 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-78e5d58b-1d35-47d8-97f2-fadfb87df41a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:33.423871 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-3ee540e0-b26d-4048-86c7-36fe4086746f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:33.435665 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3ee540e0-b26d-4048-86c7-36fe4086746f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1507 microversion: 2.1 time: 0.463600 Sep 24 03:33:33.436802 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 194/399] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:32 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1507 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:33.493133 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-78e5d58b-1d35-47d8-97f2-fadfb87df41a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:33.519957 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-78e5d58b-1d35-47d8-97f2-fadfb87df41a tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 200 len: 1505 microversion: 2.1 time: 0.323395 Sep 24 03:33:33.520750 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 206/400] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:33 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:33.619067 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-a6738d8e-9a88-4861-90a6-ddae155907ac req-d930bb0d-134e-4f1f-8709-610417817987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03c45c1-addf-4994-b5e1-5a74b2661432", "name": "network-vif-deleted", "tag": "8a89867b-79de-453d-a062-28755c7fbd4d"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:33.621068 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:33:33.621068 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:33:33.638839 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-a6738d8e-9a88-4861-90a6-ddae155907ac req-d930bb0d-134e-4f1f-8709-610417817987 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:33.639340 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-a6738d8e-9a88-4861-90a6-ddae155907ac req-d930bb0d-134e-4f1f-8709-610417817987 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:33.678196 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-a6738d8e-9a88-4861-90a6-ddae155907ac req-d930bb0d-134e-4f1f-8709-610417817987 service nova] Creating event network-vif-deleted:8a89867b-79de-453d-a062-28755c7fbd4d for instance d03c45c1-addf-4994-b5e1-5a74b2661432 on hv-cinder-81080 Sep 24 03:33:33.699147 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-a6738d8e-9a88-4861-90a6-ddae155907ac req-d930bb0d-134e-4f1f-8709-610417817987 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084443 Sep 24 03:33:33.702306 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 195/401] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:33:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:33:33.723689 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-aa105550-6296-46bb-a612-30ebab6e0919 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:33.724558 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-aa105550-6296-46bb-a612-30ebab6e0919 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:33.735409 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa105550-6296-46bb-a612-30ebab6e0919 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:33.736195 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa105550-6296-46bb-a612-30ebab6e0919 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:33.738730 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa105550-6296-46bb-a612-30ebab6e0919 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:33.741114 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa105550-6296-46bb-a612-30ebab6e0919 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:33.920789 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-aa105550-6296-46bb-a612-30ebab6e0919 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:33.939111 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-aa105550-6296-46bb-a612-30ebab6e0919 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.219817 Sep 24 03:33:33.940113 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 207/402] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:33 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:34.191746 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-7e77b576-3b59-4029-ac17-afa4422c000f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:34.192752 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-7e77b576-3b59-4029-ac17-afa4422c000f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:34.215183 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7e77b576-3b59-4029-ac17-afa4422c000f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:34.215779 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7e77b576-3b59-4029-ac17-afa4422c000f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:34.216723 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7e77b576-3b59-4029-ac17-afa4422c000f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:34.217253 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7e77b576-3b59-4029-ac17-afa4422c000f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:34.414492 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-7e77b576-3b59-4029-ac17-afa4422c000f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:34.426600 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-7e77b576-3b59-4029-ac17-afa4422c000f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:34.428609 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-7e77b576-3b59-4029-ac17-afa4422c000f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:34.431907 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-7e77b576-3b59-4029-ac17-afa4422c000f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.242688 Sep 24 03:33:34.444943 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 196/403] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:34 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:34.536929 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5b3ab56e-1308-44d0-83ab-78fc8c2d3965 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:34.537543 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5b3ab56e-1308-44d0-83ab-78fc8c2d3965 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: d03c45c1-addf-4994-b5e1-5a74b2661432] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:34.543709 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5b3ab56e-1308-44d0-83ab-78fc8c2d3965 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:34.544155 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5b3ab56e-1308-44d0-83ab-78fc8c2d3965 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:34.544918 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5b3ab56e-1308-44d0-83ab-78fc8c2d3965 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:34.545342 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5b3ab56e-1308-44d0-83ab-78fc8c2d3965 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:34.573617 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-5b3ab56e-1308-44d0-83ab-78fc8c2d3965 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] HTTP exception thrown: Instance d03c45c1-addf-4994-b5e1-5a74b2661432 could not be found. Sep 24 03:33:34.574258 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5b3ab56e-1308-44d0-83ab-78fc8c2d3965 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Returning 404 to user: Instance d03c45c1-addf-4994-b5e1-5a74b2661432 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:33:34.577374 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5b3ab56e-1308-44d0-83ab-78fc8c2d3965 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432" status: 404 len: 111 microversion: 2.1 time: 0.044878 Sep 24 03:33:34.579840 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 208/404] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:34 2021] GET /compute/v2.1/servers/d03c45c1-addf-4994-b5e1-5a74b2661432 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:33:34.717629 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-693946309", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "networks": [{"uuid": "5110320c-18ec-4819-bd21-89a3b96ba32f"}]}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:34.790679 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.network.neutron [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] validate_networks() for [('5110320c-18ec-4819-bd21-89a3b96ba32f', None, None, None, None, None)] {{(pid=109375) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:33:34.956336 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1d372683-fb89-4858-99a7-5e72add17557 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:34.956970 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1d372683-fb89-4858-99a7-5e72add17557 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:34.963438 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1d372683-fb89-4858-99a7-5e72add17557 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:34.964155 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1d372683-fb89-4858-99a7-5e72add17557 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:34.966783 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1d372683-fb89-4858-99a7-5e72add17557 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:34.967451 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1d372683-fb89-4858-99a7-5e72add17557 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:35.188243 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1d372683-fb89-4858-99a7-5e72add17557 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:35.200664 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1d372683-fb89-4858-99a7-5e72add17557 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.248153 Sep 24 03:33:35.201885 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 209/405] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:34 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:35.207359 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6fa276ef-faf7-4b27-bce9-0632fb5142c4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa6cde37-6e34-468e-9482-c2f76b475d97"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:35.208764 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6fa276ef-faf7-4b27-bce9-0632fb5142c4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:35.217262 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6fa276ef-faf7-4b27-bce9-0632fb5142c4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:35.217972 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6fa276ef-faf7-4b27-bce9-0632fb5142c4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:35.219063 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6fa276ef-faf7-4b27-bce9-0632fb5142c4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:35.220309 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6fa276ef-faf7-4b27-bce9-0632fb5142c4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:35.266552 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Flavor limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:33:35.267262 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Image limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:33:35.267911 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Flavor pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:33:35.268466 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Image pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:33:35.269193 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:33:35.284798 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:35.285239 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:35.286074 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:35.286499 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:35.308008 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Getting quotas for project d23b942bef2c49778eda908a1dfb6c1f. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:33:35.312065 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Getting quotas for user 239d6babd47248b59250fe40d9955b43 and project d23b942bef2c49778eda908a1dfb6c1f. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:33:35.327369 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Going to run 1 instances... {{(pid=109375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:33:35.330191 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:33:35.392073 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-189234df-a3df-42d2-9cf6-d4e8a33ce8bd tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677758 Sep 24 03:33:35.402583 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 197/406] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:33:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:33:35.409552 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-61be1910-94d9-4c57-a751-556123f119db tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:35.410234 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-61be1910-94d9-4c57-a751-556123f119db tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:35.470840 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-61be1910-94d9-4c57-a751-556123f119db tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:35.478040 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-61be1910-94d9-4c57-a751-556123f119db tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1213 microversion: 2.1 time: 0.073565 Sep 24 03:33:35.480991 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 198/407] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:35 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:35.495638 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-79e06122-8d8d-46a4-ab46-4535d8d6d2b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:35.496673 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-79e06122-8d8d-46a4-ab46-4535d8d6d2b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:35.505705 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-79e06122-8d8d-46a4-ab46-4535d8d6d2b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:35.506978 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-79e06122-8d8d-46a4-ab46-4535d8d6d2b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:35.508227 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-79e06122-8d8d-46a4-ab46-4535d8d6d2b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:35.509017 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-79e06122-8d8d-46a4-ab46-4535d8d6d2b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:35.597855 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6fa276ef-faf7-4b27-bce9-0632fb5142c4 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "POST /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394124 Sep 24 03:33:35.598637 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 210/408] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:33:35 2021] POST /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:33:35.690529 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-79e06122-8d8d-46a4-ab46-4535d8d6d2b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:35.702004 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-79e06122-8d8d-46a4-ab46-4535d8d6d2b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:35.708881 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-79e06122-8d8d-46a4-ab46-4535d8d6d2b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:35.713140 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-79e06122-8d8d-46a4-ab46-4535d8d6d2b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.230942 Sep 24 03:33:35.715467 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 199/409] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:35 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:36.219661 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b7abd77e-5488-43af-90eb-63b7e9439177 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:36.221989 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b7abd77e-5488-43af-90eb-63b7e9439177 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:36.234011 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b7abd77e-5488-43af-90eb-63b7e9439177 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:36.234802 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b7abd77e-5488-43af-90eb-63b7e9439177 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:36.236226 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b7abd77e-5488-43af-90eb-63b7e9439177 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:36.236647 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b7abd77e-5488-43af-90eb-63b7e9439177 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:36.382366 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b7abd77e-5488-43af-90eb-63b7e9439177 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:36.390736 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b7abd77e-5488-43af-90eb-63b7e9439177 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.175277 Sep 24 03:33:36.391388 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 211/410] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:36 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:36.511717 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ef9fb143-73de-4d36-b977-c6648c3a7aa2 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:36.513826 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ef9fb143-73de-4d36-b977-c6648c3a7aa2 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:36.525957 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ef9fb143-73de-4d36-b977-c6648c3a7aa2 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:36.526677 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ef9fb143-73de-4d36-b977-c6648c3a7aa2 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:36.527628 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ef9fb143-73de-4d36-b977-c6648c3a7aa2 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:36.528052 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ef9fb143-73de-4d36-b977-c6648c3a7aa2 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:36.623016 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ef9fb143-73de-4d36-b977-c6648c3a7aa2 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:36.641016 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ef9fb143-73de-4d36-b977-c6648c3a7aa2 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1265 microversion: 2.1 time: 0.146314 Sep 24 03:33:36.643222 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 200/411] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:36 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:36.735232 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-01b3e88d-640a-446c-866c-b6a407cd19a2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:36.738657 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-01b3e88d-640a-446c-866c-b6a407cd19a2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:36.746798 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-01b3e88d-640a-446c-866c-b6a407cd19a2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:36.750310 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-01b3e88d-640a-446c-866c-b6a407cd19a2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:36.751472 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-01b3e88d-640a-446c-866c-b6a407cd19a2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:36.753413 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-01b3e88d-640a-446c-866c-b6a407cd19a2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:36.979415 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-01b3e88d-640a-446c-866c-b6a407cd19a2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:36.989610 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-01b3e88d-640a-446c-866c-b6a407cd19a2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:36.991297 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-01b3e88d-640a-446c-866c-b6a407cd19a2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:36.992465 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-01b3e88d-640a-446c-866c-b6a407cd19a2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.263884 Sep 24 03:33:36.993021 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 212/412] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:36 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:33:37.408905 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9cc37685-2a64-4fe8-b1b3-ba7e13244042 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:37.421122 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9cc37685-2a64-4fe8-b1b3-ba7e13244042 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:37.467754 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9cc37685-2a64-4fe8-b1b3-ba7e13244042 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:37.468195 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9cc37685-2a64-4fe8-b1b3-ba7e13244042 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:37.469012 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9cc37685-2a64-4fe8-b1b3-ba7e13244042 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:37.469436 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9cc37685-2a64-4fe8-b1b3-ba7e13244042 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:37.631489 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9cc37685-2a64-4fe8-b1b3-ba7e13244042 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:37.641702 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9cc37685-2a64-4fe8-b1b3-ba7e13244042 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.237302 Sep 24 03:33:37.644472 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 201/413] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:37 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:37.660920 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d1ca846f-e43a-4bdd-ae5b-bfbda904c49d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:37.661523 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d1ca846f-e43a-4bdd-ae5b-bfbda904c49d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:37.670671 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d1ca846f-e43a-4bdd-ae5b-bfbda904c49d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:37.671319 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d1ca846f-e43a-4bdd-ae5b-bfbda904c49d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:37.672103 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d1ca846f-e43a-4bdd-ae5b-bfbda904c49d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:37.672530 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d1ca846f-e43a-4bdd-ae5b-bfbda904c49d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:37.836963 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d1ca846f-e43a-4bdd-ae5b-bfbda904c49d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:37.855256 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d1ca846f-e43a-4bdd-ae5b-bfbda904c49d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.199001 Sep 24 03:33:37.856784 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 213/414] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:37 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:38.010984 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-da262fab-f424-4b54-b1a8-d1ec54cf9c25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:38.011878 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-da262fab-f424-4b54-b1a8-d1ec54cf9c25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:38.020703 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-da262fab-f424-4b54-b1a8-d1ec54cf9c25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:38.021144 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-da262fab-f424-4b54-b1a8-d1ec54cf9c25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:38.021966 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-da262fab-f424-4b54-b1a8-d1ec54cf9c25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:38.022536 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-da262fab-f424-4b54-b1a8-d1ec54cf9c25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:38.167130 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-da262fab-f424-4b54-b1a8-d1ec54cf9c25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:38.176411 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-da262fab-f424-4b54-b1a8-d1ec54cf9c25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:38.178051 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-da262fab-f424-4b54-b1a8-d1ec54cf9c25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:38.179269 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-da262fab-f424-4b54-b1a8-d1ec54cf9c25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.171938 Sep 24 03:33:38.179854 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 202/415] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:38 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:38.509380 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-ee679e44-1e8d-48ff-9406-3743b5d846ac req-99c49d0c-3f15-4efd-a51c-796cdd3a5d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ef1d15-e520-4dff-8106-a8264da94054", "tag": "dbe23751-535d-46cb-96da-0ad01cf14019"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:38.511966 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:33:38.511966 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:33:38.532069 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-ee679e44-1e8d-48ff-9406-3743b5d846ac req-99c49d0c-3f15-4efd-a51c-796cdd3a5d58 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:38.534873 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-ee679e44-1e8d-48ff-9406-3743b5d846ac req-99c49d0c-3f15-4efd-a51c-796cdd3a5d58 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:38.559498 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-ee679e44-1e8d-48ff-9406-3743b5d846ac req-99c49d0c-3f15-4efd-a51c-796cdd3a5d58 service nova] Creating event network-changed:dbe23751-535d-46cb-96da-0ad01cf14019 for instance 97ef1d15-e520-4dff-8106-a8264da94054 on hv-cinder-81080 Sep 24 03:33:38.565466 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-ee679e44-1e8d-48ff-9406-3743b5d846ac req-99c49d0c-3f15-4efd-a51c-796cdd3a5d58 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061331 Sep 24 03:33:38.566471 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 214/416] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:33:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:33:38.661918 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-61240687-4371-45ff-ba33-ca567383efbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:38.665553 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-61240687-4371-45ff-ba33-ca567383efbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:38.674541 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-61240687-4371-45ff-ba33-ca567383efbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:38.675112 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-61240687-4371-45ff-ba33-ca567383efbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:38.675960 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-61240687-4371-45ff-ba33-ca567383efbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:38.676516 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-61240687-4371-45ff-ba33-ca567383efbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:38.856199 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-61240687-4371-45ff-ba33-ca567383efbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:38.866077 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-61240687-4371-45ff-ba33-ca567383efbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.209492 Sep 24 03:33:38.867072 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 203/417] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:38 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:38.874169 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e549e73e-b2f5-48c9-a5b2-c3029d5242ee tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:38.875417 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e549e73e-b2f5-48c9-a5b2-c3029d5242ee tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:38.881872 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e549e73e-b2f5-48c9-a5b2-c3029d5242ee tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:38.882310 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e549e73e-b2f5-48c9-a5b2-c3029d5242ee tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:38.883069 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e549e73e-b2f5-48c9-a5b2-c3029d5242ee tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:38.883485 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e549e73e-b2f5-48c9-a5b2-c3029d5242ee tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:39.054407 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e549e73e-b2f5-48c9-a5b2-c3029d5242ee tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:39.061990 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e549e73e-b2f5-48c9-a5b2-c3029d5242ee tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.192158 Sep 24 03:33:39.062560 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 215/418] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:38 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:39.196583 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d1dea2ff-c277-4dcc-a367-31d2a3fab6c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:39.197231 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d1dea2ff-c277-4dcc-a367-31d2a3fab6c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:39.203878 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d1dea2ff-c277-4dcc-a367-31d2a3fab6c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:39.204085 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d1dea2ff-c277-4dcc-a367-31d2a3fab6c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:39.205013 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d1dea2ff-c277-4dcc-a367-31d2a3fab6c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:39.205526 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d1dea2ff-c277-4dcc-a367-31d2a3fab6c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:39.363719 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d1dea2ff-c277-4dcc-a367-31d2a3fab6c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:39.377638 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d1dea2ff-c277-4dcc-a367-31d2a3fab6c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:39.379686 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d1dea2ff-c277-4dcc-a367-31d2a3fab6c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:39.381037 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d1dea2ff-c277-4dcc-a367-31d2a3fab6c2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.188543 Sep 24 03:33:39.393780 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 204/419] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:39 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:33:39.883504 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-34d6563c-280f-4d25-b957-8e70bdc1ebcf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:39.884098 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-34d6563c-280f-4d25-b957-8e70bdc1ebcf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:39.890327 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34d6563c-280f-4d25-b957-8e70bdc1ebcf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:39.890766 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34d6563c-280f-4d25-b957-8e70bdc1ebcf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:39.891525 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34d6563c-280f-4d25-b957-8e70bdc1ebcf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:39.892223 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34d6563c-280f-4d25-b957-8e70bdc1ebcf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:40.022153 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-34d6563c-280f-4d25-b957-8e70bdc1ebcf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:40.035108 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-34d6563c-280f-4d25-b957-8e70bdc1ebcf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.154883 Sep 24 03:33:40.036347 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 216/420] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:39 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:40.079851 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b7b9dc3a-7979-47fb-bbda-23854f8a705b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:40.081004 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b7b9dc3a-7979-47fb-bbda-23854f8a705b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:40.088703 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b7b9dc3a-7979-47fb-bbda-23854f8a705b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:40.089145 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b7b9dc3a-7979-47fb-bbda-23854f8a705b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:40.089949 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b7b9dc3a-7979-47fb-bbda-23854f8a705b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:40.090376 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b7b9dc3a-7979-47fb-bbda-23854f8a705b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:40.259304 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b7b9dc3a-7979-47fb-bbda-23854f8a705b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:40.267891 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b7b9dc3a-7979-47fb-bbda-23854f8a705b tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.192121 Sep 24 03:33:40.284430 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 205/421] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:40 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:40.403847 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2a5cf6ad-0739-481b-add7-d00681ac0e21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:40.404936 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2a5cf6ad-0739-481b-add7-d00681ac0e21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:40.412011 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a5cf6ad-0739-481b-add7-d00681ac0e21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:40.412446 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a5cf6ad-0739-481b-add7-d00681ac0e21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:40.413216 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a5cf6ad-0739-481b-add7-d00681ac0e21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:40.413636 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a5cf6ad-0739-481b-add7-d00681ac0e21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:40.553543 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2a5cf6ad-0739-481b-add7-d00681ac0e21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:40.565014 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2a5cf6ad-0739-481b-add7-d00681ac0e21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:40.566857 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2a5cf6ad-0739-481b-add7-d00681ac0e21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:40.568106 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2a5cf6ad-0739-481b-add7-d00681ac0e21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.168054 Sep 24 03:33:40.569051 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 217/422] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:40 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:40.775941 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3274d9bf-f934-47b0-bcf1-989796adca46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:40.777535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3274d9bf-f934-47b0-bcf1-989796adca46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:40.784412 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3274d9bf-f934-47b0-bcf1-989796adca46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:40.784846 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3274d9bf-f934-47b0-bcf1-989796adca46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:40.785640 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3274d9bf-f934-47b0-bcf1-989796adca46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:40.786099 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3274d9bf-f934-47b0-bcf1-989796adca46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:40.809696 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-3274d9bf-f934-47b0-bcf1-989796adca46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lazy-loading 'flavor' on Instance uuid 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:33:40.953931 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3274d9bf-f934-47b0-bcf1-989796adca46 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "POST /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/action" status: 200 len: 32 microversion: 2.1 time: 0.181318 Sep 24 03:33:40.956101 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 206/423] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:40 2021] POST /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:33:40.965165 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-09a8ce72-1cf6-4ab2-be2c-cc31a7b10fe2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:40.965888 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-09a8ce72-1cf6-4ab2-be2c-cc31a7b10fe2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:40.974750 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-09a8ce72-1cf6-4ab2-be2c-cc31a7b10fe2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:40.975307 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-09a8ce72-1cf6-4ab2-be2c-cc31a7b10fe2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:40.976200 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-09a8ce72-1cf6-4ab2-be2c-cc31a7b10fe2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:40.976670 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-09a8ce72-1cf6-4ab2-be2c-cc31a7b10fe2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:41.039860 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-7b5bc4bb-593b-4357-a117-b43ece68d88d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Action: 'create', calling method: .version_select at 0x7f6664399160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1633299866"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:41.071378 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-7b5bc4bb-593b-4357-a117-b43ece68d88d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Getting quotas for project b8aafe7ea28c45d79b2cb49f09c3c82f. Resources: {'key_pairs'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:33:41.075468 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-7b5bc4bb-593b-4357-a117-b43ece68d88d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Getting quotas for user fff280c7d78b4febb8ef3abe52b8f2c1 and project b8aafe7ea28c45d79b2cb49f09c3c82f. Resources: {'key_pairs'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:33:41.137658 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-09a8ce72-1cf6-4ab2-be2c-cc31a7b10fe2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:41.145383 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-09a8ce72-1cf6-4ab2-be2c-cc31a7b10fe2 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.184034 Sep 24 03:33:41.145984 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 218/424] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:40 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:41.159102 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-fef10021-337f-4ab2-a75a-100858c02fe0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:41.159102 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-fef10021-337f-4ab2-a75a-100858c02fe0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:41.174076 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fef10021-337f-4ab2-a75a-100858c02fe0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:41.174633 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fef10021-337f-4ab2-a75a-100858c02fe0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:41.176484 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fef10021-337f-4ab2-a75a-100858c02fe0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:41.177053 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fef10021-337f-4ab2-a75a-100858c02fe0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:41.236859 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-7b5bc4bb-593b-4357-a117-b43ece68d88d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Getting quotas for project b8aafe7ea28c45d79b2cb49f09c3c82f. Resources: {'key_pairs'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:33:41.240576 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-7b5bc4bb-593b-4357-a117-b43ece68d88d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Getting quotas for user fff280c7d78b4febb8ef3abe52b8f2c1 and project b8aafe7ea28c45d79b2cb49f09c3c82f. Resources: {'key_pairs'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:33:41.254857 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-7b5bc4bb-593b-4357-a117-b43ece68d88d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.219122 Sep 24 03:33:41.255469 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 207/425] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Sep 24 03:33:41 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:41.289144 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-4b258071-ac15-4ab0-bfd2-d7b1ad767028 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:41.289909 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-4b258071-ac15-4ab0-bfd2-d7b1ad767028 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:41.298633 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4b258071-ac15-4ab0-bfd2-d7b1ad767028 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:41.299432 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4b258071-ac15-4ab0-bfd2-d7b1ad767028 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:41.300239 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4b258071-ac15-4ab0-bfd2-d7b1ad767028 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:41.300665 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4b258071-ac15-4ab0-bfd2-d7b1ad767028 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:41.326866 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-fef10021-337f-4ab2-a75a-100858c02fe0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:41.335414 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-fef10021-337f-4ab2-a75a-100858c02fe0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.187245 Sep 24 03:33:41.342746 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 219/426] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:41 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:41.342746 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1083730427", "imageRef": "f3d3f958-9d4c-441a-a8d8-4f5a93bd577a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1633299866", "networks": [{"uuid": "6448989d-b885-499e-a084-9678a302db42"}]}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:41.392254 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.network.neutron [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] validate_networks() for [('6448989d-b885-499e-a084-9678a302db42', None, None, None, None, None)] {{(pid=109374) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:33:41.476985 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4b258071-ac15-4ab0-bfd2-d7b1ad767028 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:41.484261 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-4b258071-ac15-4ab0-bfd2-d7b1ad767028 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.198658 Sep 24 03:33:41.494079 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 208/427] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:41 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:41.586781 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9f440002-a63f-4978-974e-840f2fb9fd4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:41.587587 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9f440002-a63f-4978-974e-840f2fb9fd4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:41.593775 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9f440002-a63f-4978-974e-840f2fb9fd4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:41.594291 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9f440002-a63f-4978-974e-840f2fb9fd4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:41.595725 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9f440002-a63f-4978-974e-840f2fb9fd4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:41.596216 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9f440002-a63f-4978-974e-840f2fb9fd4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:41.804750 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9f440002-a63f-4978-974e-840f2fb9fd4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:41.812716 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9f440002-a63f-4978-974e-840f2fb9fd4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:41.814339 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9f440002-a63f-4978-974e-840f2fb9fd4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:41.815746 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9f440002-a63f-4978-974e-840f2fb9fd4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.233215 Sep 24 03:33:41.816631 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 209/428] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:41 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:33:41.867295 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Flavor limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:33:41.867711 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Image limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:33:41.868173 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Flavor pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:33:41.868573 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Image pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:33:41.869040 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:33:41.877786 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:41.878210 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:41.879006 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:41.879429 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:41.896588 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Getting quotas for project b8aafe7ea28c45d79b2cb49f09c3c82f. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:33:41.900391 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Getting quotas for user fff280c7d78b4febb8ef3abe52b8f2c1 and project b8aafe7ea28c45d79b2cb49f09c3c82f. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:33:41.912950 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Going to run 1 instances... {{(pid=109374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:33:41.915252 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f3d3f958-9d4c-441a-a8d8-4f5a93bd577a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:33:41.959636 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a0b235d6-45d7-4005-8ab6-ef7e61299b63 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622318 Sep 24 03:33:41.960577 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 220/429] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:33:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:33:41.971203 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ccee2f28-c813-44f1-a54e-d310fd121b13 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:41.972100 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ccee2f28-c813-44f1-a54e-d310fd121b13 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:42.023290 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ccee2f28-c813-44f1-a54e-d310fd121b13 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:42.029548 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ccee2f28-c813-44f1-a54e-d310fd121b13 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1259 microversion: 2.1 time: 0.063081 Sep 24 03:33:42.030140 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 210/430] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:41 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1259 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:42.202208 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6067afcd-c39b-4c68-b425-863f253b3681 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:42.203333 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6067afcd-c39b-4c68-b425-863f253b3681 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:42.210270 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6067afcd-c39b-4c68-b425-863f253b3681 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:42.210954 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6067afcd-c39b-4c68-b425-863f253b3681 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:42.211922 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6067afcd-c39b-4c68-b425-863f253b3681 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:42.212781 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6067afcd-c39b-4c68-b425-863f253b3681 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:42.343790 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6067afcd-c39b-4c68-b425-863f253b3681 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:42.351881 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6067afcd-c39b-4c68-b425-863f253b3681 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.153252 Sep 24 03:33:42.352136 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9c68c90e-5459-49e3-81dc-fe2541ddc48d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:42.352791 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 221/431] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:42 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:42.354135 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9c68c90e-5459-49e3-81dc-fe2541ddc48d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:42.360076 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c68c90e-5459-49e3-81dc-fe2541ddc48d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:42.360655 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c68c90e-5459-49e3-81dc-fe2541ddc48d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:42.361668 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c68c90e-5459-49e3-81dc-fe2541ddc48d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:42.362211 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c68c90e-5459-49e3-81dc-fe2541ddc48d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:42.497125 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9c68c90e-5459-49e3-81dc-fe2541ddc48d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:42.502081 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c7aab77c-5ed4-4a2f-b4b9-5b8588b198e0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:42.502715 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c7aab77c-5ed4-4a2f-b4b9-5b8588b198e0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:42.509207 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9c68c90e-5459-49e3-81dc-fe2541ddc48d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.160745 Sep 24 03:33:42.509412 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7aab77c-5ed4-4a2f-b4b9-5b8588b198e0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:42.509788 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7aab77c-5ed4-4a2f-b4b9-5b8588b198e0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:42.510125 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 211/432] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:42 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:42.510833 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7aab77c-5ed4-4a2f-b4b9-5b8588b198e0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:42.511335 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7aab77c-5ed4-4a2f-b4b9-5b8588b198e0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:42.645400 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c7aab77c-5ed4-4a2f-b4b9-5b8588b198e0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:42.652708 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c7aab77c-5ed4-4a2f-b4b9-5b8588b198e0 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.154914 Sep 24 03:33:42.653272 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 222/433] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:42 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:42.834467 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-62f50ba7-3236-4e76-bf82-f1f667f85748 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:42.834998 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-62f50ba7-3236-4e76-bf82-f1f667f85748 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:42.841091 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-62f50ba7-3236-4e76-bf82-f1f667f85748 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:42.841535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-62f50ba7-3236-4e76-bf82-f1f667f85748 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:42.842546 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-62f50ba7-3236-4e76-bf82-f1f667f85748 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:42.842971 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-62f50ba7-3236-4e76-bf82-f1f667f85748 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:42.974509 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-62f50ba7-3236-4e76-bf82-f1f667f85748 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:42.982274 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-62f50ba7-3236-4e76-bf82-f1f667f85748 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:42.983768 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-62f50ba7-3236-4e76-bf82-f1f667f85748 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:42.984916 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-62f50ba7-3236-4e76-bf82-f1f667f85748 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.154337 Sep 24 03:33:42.986086 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 212/434] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:42 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:33:43.046641 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9640ebcb-6a7e-4a5a-ae1c-12ed6852d69f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:43.047253 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9640ebcb-6a7e-4a5a-ae1c-12ed6852d69f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:43.053493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9640ebcb-6a7e-4a5a-ae1c-12ed6852d69f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:43.053972 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9640ebcb-6a7e-4a5a-ae1c-12ed6852d69f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:43.054750 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9640ebcb-6a7e-4a5a-ae1c-12ed6852d69f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:43.055177 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9640ebcb-6a7e-4a5a-ae1c-12ed6852d69f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:43.127605 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-9640ebcb-6a7e-4a5a-ae1c-12ed6852d69f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:43.135265 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9640ebcb-6a7e-4a5a-ae1c-12ed6852d69f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1319 microversion: 2.1 time: 0.092358 Sep 24 03:33:43.136205 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 223/435] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:43 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1319 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:43.368892 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-898aba4f-f2e9-4521-82b0-38ebd95dc378 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:43.369635 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-898aba4f-f2e9-4521-82b0-38ebd95dc378 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:43.375579 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-898aba4f-f2e9-4521-82b0-38ebd95dc378 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:43.376627 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-898aba4f-f2e9-4521-82b0-38ebd95dc378 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:43.377491 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-898aba4f-f2e9-4521-82b0-38ebd95dc378 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:43.377957 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-898aba4f-f2e9-4521-82b0-38ebd95dc378 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:43.504964 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-898aba4f-f2e9-4521-82b0-38ebd95dc378 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:43.512779 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-898aba4f-f2e9-4521-82b0-38ebd95dc378 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.147475 Sep 24 03:33:43.513335 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 213/436] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:43 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:43.526088 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3aef6f57-eb77-4141-9201-d223b1dc0aa8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:43.526687 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3aef6f57-eb77-4141-9201-d223b1dc0aa8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:43.533489 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3aef6f57-eb77-4141-9201-d223b1dc0aa8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:43.533898 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3aef6f57-eb77-4141-9201-d223b1dc0aa8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:43.534669 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3aef6f57-eb77-4141-9201-d223b1dc0aa8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:43.535094 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3aef6f57-eb77-4141-9201-d223b1dc0aa8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:43.670476 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-12aa4990-6657-49f3-b229-31a6f20e8149 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:43.671399 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-12aa4990-6657-49f3-b229-31a6f20e8149 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:43.679662 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-12aa4990-6657-49f3-b229-31a6f20e8149 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:43.681617 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-12aa4990-6657-49f3-b229-31a6f20e8149 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:43.683955 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-12aa4990-6657-49f3-b229-31a6f20e8149 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:43.684547 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-12aa4990-6657-49f3-b229-31a6f20e8149 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:43.729050 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3aef6f57-eb77-4141-9201-d223b1dc0aa8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:43.745016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3aef6f57-eb77-4141-9201-d223b1dc0aa8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.222456 Sep 24 03:33:43.746390 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 224/437] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:43 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:43.914197 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-12aa4990-6657-49f3-b229-31a6f20e8149 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:43.928624 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-12aa4990-6657-49f3-b229-31a6f20e8149 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.261740 Sep 24 03:33:43.930065 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 214/438] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:43 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:44.003774 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-60d3fb5d-2965-4a90-a484-44d7a6951754 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:44.004460 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-60d3fb5d-2965-4a90-a484-44d7a6951754 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:44.011349 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60d3fb5d-2965-4a90-a484-44d7a6951754 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:44.011850 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60d3fb5d-2965-4a90-a484-44d7a6951754 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:44.012842 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60d3fb5d-2965-4a90-a484-44d7a6951754 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:44.013274 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60d3fb5d-2965-4a90-a484-44d7a6951754 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:44.153736 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ad6b0f54-abbb-49f0-a1f4-39136936d6c5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:44.154396 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ad6b0f54-abbb-49f0-a1f4-39136936d6c5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:44.164984 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-60d3fb5d-2965-4a90-a484-44d7a6951754 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:44.168995 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad6b0f54-abbb-49f0-a1f4-39136936d6c5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:44.171869 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad6b0f54-abbb-49f0-a1f4-39136936d6c5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:44.175113 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-60d3fb5d-2965-4a90-a484-44d7a6951754 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:44.176213 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad6b0f54-abbb-49f0-a1f4-39136936d6c5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:44.176810 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad6b0f54-abbb-49f0-a1f4-39136936d6c5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:44.181553 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-60d3fb5d-2965-4a90-a484-44d7a6951754 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:44.184344 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-60d3fb5d-2965-4a90-a484-44d7a6951754 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.185441 Sep 24 03:33:44.194095 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 225/439] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:43 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:33:44.320185 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ad6b0f54-abbb-49f0-a1f4-39136936d6c5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:44.327436 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ad6b0f54-abbb-49f0-a1f4-39136936d6c5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.178324 Sep 24 03:33:44.328009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 215/440] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:44 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:44.531011 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8fbc850b-2a8d-4525-8417-040ba0a40637 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:44.533165 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8fbc850b-2a8d-4525-8417-040ba0a40637 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:44.539405 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8fbc850b-2a8d-4525-8417-040ba0a40637 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:44.539936 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8fbc850b-2a8d-4525-8417-040ba0a40637 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:44.540699 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8fbc850b-2a8d-4525-8417-040ba0a40637 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:44.541120 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8fbc850b-2a8d-4525-8417-040ba0a40637 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:44.670069 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8fbc850b-2a8d-4525-8417-040ba0a40637 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:44.679821 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8fbc850b-2a8d-4525-8417-040ba0a40637 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.152795 Sep 24 03:33:44.681260 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 226/441] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:44 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:44.764149 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c7213ece-894d-4263-a4fd-053e7f329dd9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:44.764919 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c7213ece-894d-4263-a4fd-053e7f329dd9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:44.772532 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c7213ece-894d-4263-a4fd-053e7f329dd9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:44.772975 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c7213ece-894d-4263-a4fd-053e7f329dd9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:44.773786 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c7213ece-894d-4263-a4fd-053e7f329dd9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:44.774210 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c7213ece-894d-4263-a4fd-053e7f329dd9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:44.905062 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c7213ece-894d-4263-a4fd-053e7f329dd9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:44.913392 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c7213ece-894d-4263-a4fd-053e7f329dd9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.153285 Sep 24 03:33:44.914010 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 216/442] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:44 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:44.945554 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2f459e0a-5bd2-4196-a388-d18f0a1a44a7 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:44.946196 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2f459e0a-5bd2-4196-a388-d18f0a1a44a7 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:44.952269 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f459e0a-5bd2-4196-a388-d18f0a1a44a7 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:44.952741 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f459e0a-5bd2-4196-a388-d18f0a1a44a7 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:44.953508 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f459e0a-5bd2-4196-a388-d18f0a1a44a7 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:44.954027 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f459e0a-5bd2-4196-a388-d18f0a1a44a7 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:45.083756 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2f459e0a-5bd2-4196-a388-d18f0a1a44a7 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:45.091015 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2f459e0a-5bd2-4196-a388-d18f0a1a44a7 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.149116 Sep 24 03:33:45.091584 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 227/443] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:44 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:45.211149 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9114d53a-3e4e-43c0-9139-62e06f2e8ebf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:45.211747 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9114d53a-3e4e-43c0-9139-62e06f2e8ebf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:45.217945 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9114d53a-3e4e-43c0-9139-62e06f2e8ebf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:45.218592 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9114d53a-3e4e-43c0-9139-62e06f2e8ebf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:45.219485 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9114d53a-3e4e-43c0-9139-62e06f2e8ebf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:45.220158 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9114d53a-3e4e-43c0-9139-62e06f2e8ebf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:45.344561 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-98e1f126-2af1-4257-af2e-3cef9f7e0b1a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:45.345432 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-98e1f126-2af1-4257-af2e-3cef9f7e0b1a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:45.346628 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9114d53a-3e4e-43c0-9139-62e06f2e8ebf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:45.351989 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-98e1f126-2af1-4257-af2e-3cef9f7e0b1a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:45.352561 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-98e1f126-2af1-4257-af2e-3cef9f7e0b1a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:45.353440 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-98e1f126-2af1-4257-af2e-3cef9f7e0b1a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:45.353994 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-98e1f126-2af1-4257-af2e-3cef9f7e0b1a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:45.355480 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9114d53a-3e4e-43c0-9139-62e06f2e8ebf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:45.357202 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9114d53a-3e4e-43c0-9139-62e06f2e8ebf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:45.358567 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9114d53a-3e4e-43c0-9139-62e06f2e8ebf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.151253 Sep 24 03:33:45.359294 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 217/444] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:45 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:45.491844 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-98e1f126-2af1-4257-af2e-3cef9f7e0b1a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:45.499964 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-98e1f126-2af1-4257-af2e-3cef9f7e0b1a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.159262 Sep 24 03:33:45.500748 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 228/445] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:45 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:45.697939 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f10316f1-1815-4221-95ed-6f9b72a2412d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:45.698459 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f10316f1-1815-4221-95ed-6f9b72a2412d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:45.711707 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f10316f1-1815-4221-95ed-6f9b72a2412d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:45.712156 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f10316f1-1815-4221-95ed-6f9b72a2412d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:45.712924 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f10316f1-1815-4221-95ed-6f9b72a2412d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:45.713348 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f10316f1-1815-4221-95ed-6f9b72a2412d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:45.839880 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-f10316f1-1815-4221-95ed-6f9b72a2412d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:45.848077 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f10316f1-1815-4221-95ed-6f9b72a2412d tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.154160 Sep 24 03:33:45.848795 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 218/446] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:45 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:45.931209 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-484663a6-5610-4c0c-8330-869ba89d7683 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:45.931969 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-484663a6-5610-4c0c-8330-869ba89d7683 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:45.939933 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-484663a6-5610-4c0c-8330-869ba89d7683 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:45.940608 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-484663a6-5610-4c0c-8330-869ba89d7683 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:45.941381 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-484663a6-5610-4c0c-8330-869ba89d7683 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:45.941857 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-484663a6-5610-4c0c-8330-869ba89d7683 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:46.069032 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-484663a6-5610-4c0c-8330-869ba89d7683 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:46.076780 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-484663a6-5610-4c0c-8330-869ba89d7683 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.149645 Sep 24 03:33:46.077339 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 229/447] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:45 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:46.108289 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-0585d8e8-365e-443d-affd-4b26df0e6e9c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:46.108908 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-0585d8e8-365e-443d-affd-4b26df0e6e9c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:46.116234 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0585d8e8-365e-443d-affd-4b26df0e6e9c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:46.116707 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0585d8e8-365e-443d-affd-4b26df0e6e9c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:46.117591 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0585d8e8-365e-443d-affd-4b26df0e6e9c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:46.118053 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0585d8e8-365e-443d-affd-4b26df0e6e9c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:46.245047 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-0585d8e8-365e-443d-affd-4b26df0e6e9c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:46.254929 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-0585d8e8-365e-443d-affd-4b26df0e6e9c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.150135 Sep 24 03:33:46.255704 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 219/448] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:46 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:46.379262 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-455765c2-97d7-487d-958d-8d1f7512872b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:46.379874 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-455765c2-97d7-487d-958d-8d1f7512872b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:46.389074 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-455765c2-97d7-487d-958d-8d1f7512872b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:46.389583 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-455765c2-97d7-487d-958d-8d1f7512872b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:46.390446 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-455765c2-97d7-487d-958d-8d1f7512872b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:46.390875 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-455765c2-97d7-487d-958d-8d1f7512872b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:46.513033 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-a0345606-6fdb-48b7-9c28-54c4665c1425 req-b4d0222b-ff97-4a9d-836c-a760bec7deca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ef1d15-e520-4dff-8106-a8264da94054", "name": "network-vif-plugged", "status": "completed", "tag": "dbe23751-535d-46cb-96da-0ad01cf14019"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:46.524141 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:33:46.524141 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:33:46.540662 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-a0345606-6fdb-48b7-9c28-54c4665c1425 req-b4d0222b-ff97-4a9d-836c-a760bec7deca service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:46.541118 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-a0345606-6fdb-48b7-9c28-54c4665c1425 req-b4d0222b-ff97-4a9d-836c-a760bec7deca service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:46.555911 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-a0345606-6fdb-48b7-9c28-54c4665c1425 req-b4d0222b-ff97-4a9d-836c-a760bec7deca service nova] Creating event network-vif-plugged:dbe23751-535d-46cb-96da-0ad01cf14019 for instance 97ef1d15-e520-4dff-8106-a8264da94054 on hv-cinder-81080 Sep 24 03:33:46.561181 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-a0345606-6fdb-48b7-9c28-54c4665c1425 req-b4d0222b-ff97-4a9d-836c-a760bec7deca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053323 Sep 24 03:33:46.562839 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 220/449] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:33:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:33:46.567030 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9c059f0b-0814-453d-8108-33b3ed23ed20 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:46.568000 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9c059f0b-0814-453d-8108-33b3ed23ed20 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:46.574235 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c059f0b-0814-453d-8108-33b3ed23ed20 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:46.574374 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-455765c2-97d7-487d-958d-8d1f7512872b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:46.575035 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c059f0b-0814-453d-8108-33b3ed23ed20 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:46.578039 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c059f0b-0814-453d-8108-33b3ed23ed20 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:46.582443 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c059f0b-0814-453d-8108-33b3ed23ed20 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:46.583961 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-455765c2-97d7-487d-958d-8d1f7512872b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:46.585536 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-455765c2-97d7-487d-958d-8d1f7512872b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:46.586823 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-455765c2-97d7-487d-958d-8d1f7512872b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.212606 Sep 24 03:33:46.587487 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 230/450] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:46 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:46.723925 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9c059f0b-0814-453d-8108-33b3ed23ed20 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:46.731186 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9c059f0b-0814-453d-8108-33b3ed23ed20 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.167925 Sep 24 03:33:46.731752 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 221/451] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:46 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:46.864994 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d87c40e5-5e5e-4915-92b8-28e867387ac7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:46.865506 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d87c40e5-5e5e-4915-92b8-28e867387ac7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:46.871529 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d87c40e5-5e5e-4915-92b8-28e867387ac7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:46.871968 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d87c40e5-5e5e-4915-92b8-28e867387ac7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:46.872728 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d87c40e5-5e5e-4915-92b8-28e867387ac7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:46.873153 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d87c40e5-5e5e-4915-92b8-28e867387ac7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:47.000238 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d87c40e5-5e5e-4915-92b8-28e867387ac7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:47.009101 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d87c40e5-5e5e-4915-92b8-28e867387ac7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.148521 Sep 24 03:33:47.009672 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 231/452] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:46 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:47.094107 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f9008405-cbc1-409f-b1cd-59dc4c2e004b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:47.094794 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f9008405-cbc1-409f-b1cd-59dc4c2e004b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:47.101457 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f9008405-cbc1-409f-b1cd-59dc4c2e004b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:47.101940 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f9008405-cbc1-409f-b1cd-59dc4c2e004b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:47.102706 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f9008405-cbc1-409f-b1cd-59dc4c2e004b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:47.103126 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f9008405-cbc1-409f-b1cd-59dc4c2e004b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:47.236770 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-f9008405-cbc1-409f-b1cd-59dc4c2e004b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:47.244782 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f9008405-cbc1-409f-b1cd-59dc4c2e004b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.154775 Sep 24 03:33:47.245346 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 222/453] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:47 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:47.271510 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a62f3f90-f780-469b-84e1-b074c5064621 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:47.272112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a62f3f90-f780-469b-84e1-b074c5064621 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:47.277880 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a62f3f90-f780-469b-84e1-b074c5064621 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:47.278325 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a62f3f90-f780-469b-84e1-b074c5064621 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:47.279081 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a62f3f90-f780-469b-84e1-b074c5064621 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:47.279524 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a62f3f90-f780-469b-84e1-b074c5064621 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:47.402270 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a62f3f90-f780-469b-84e1-b074c5064621 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:47.411460 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a62f3f90-f780-469b-84e1-b074c5064621 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.142762 Sep 24 03:33:47.411460 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 232/454] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:47 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:47.605825 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-80ebf45e-5ce0-4fc2-8ac9-41f17c0a8dd8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:47.606452 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-80ebf45e-5ce0-4fc2-8ac9-41f17c0a8dd8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:47.615394 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-80ebf45e-5ce0-4fc2-8ac9-41f17c0a8dd8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:47.616275 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-80ebf45e-5ce0-4fc2-8ac9-41f17c0a8dd8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:47.617072 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-80ebf45e-5ce0-4fc2-8ac9-41f17c0a8dd8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:47.617534 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-80ebf45e-5ce0-4fc2-8ac9-41f17c0a8dd8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:47.754325 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d26484c4-32ab-48f2-9acd-96df86f192b1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:47.754891 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d26484c4-32ab-48f2-9acd-96df86f192b1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:47.763827 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-80ebf45e-5ce0-4fc2-8ac9-41f17c0a8dd8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:47.769345 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d26484c4-32ab-48f2-9acd-96df86f192b1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:47.769963 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d26484c4-32ab-48f2-9acd-96df86f192b1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:47.770873 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d26484c4-32ab-48f2-9acd-96df86f192b1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:47.771261 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d26484c4-32ab-48f2-9acd-96df86f192b1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:47.783544 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-80ebf45e-5ce0-4fc2-8ac9-41f17c0a8dd8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:47.785397 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-80ebf45e-5ce0-4fc2-8ac9-41f17c0a8dd8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:47.786767 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-80ebf45e-5ce0-4fc2-8ac9-41f17c0a8dd8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.184988 Sep 24 03:33:47.787464 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 223/455] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:47 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:47.896803 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d26484c4-32ab-48f2-9acd-96df86f192b1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:47.903975 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d26484c4-32ab-48f2-9acd-96df86f192b1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.157834 Sep 24 03:33:47.904541 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 233/456] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:47 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:48.026072 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5aa43559-67c2-49f0-b93a-382beab4f19f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:48.026634 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5aa43559-67c2-49f0-b93a-382beab4f19f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:48.032947 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5aa43559-67c2-49f0-b93a-382beab4f19f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:48.033399 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5aa43559-67c2-49f0-b93a-382beab4f19f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:48.034419 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5aa43559-67c2-49f0-b93a-382beab4f19f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:48.034873 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5aa43559-67c2-49f0-b93a-382beab4f19f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:48.161035 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5aa43559-67c2-49f0-b93a-382beab4f19f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:48.168702 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5aa43559-67c2-49f0-b93a-382beab4f19f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.146358 Sep 24 03:33:48.169267 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 224/457] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:48 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:48.262337 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c611288e-0834-42c4-ba5b-32e51c6fb3eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:48.262927 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c611288e-0834-42c4-ba5b-32e51c6fb3eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:48.269453 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c611288e-0834-42c4-ba5b-32e51c6fb3eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:48.269930 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c611288e-0834-42c4-ba5b-32e51c6fb3eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:48.270706 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c611288e-0834-42c4-ba5b-32e51c6fb3eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:48.271125 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c611288e-0834-42c4-ba5b-32e51c6fb3eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:48.394517 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c611288e-0834-42c4-ba5b-32e51c6fb3eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:48.402143 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c611288e-0834-42c4-ba5b-32e51c6fb3eb tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.143379 Sep 24 03:33:48.402700 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 234/458] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:48 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:48.427027 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ee6ac388-5233-4c20-ac1e-aa31d2621579 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:48.427788 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ee6ac388-5233-4c20-ac1e-aa31d2621579 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:48.435862 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ee6ac388-5233-4c20-ac1e-aa31d2621579 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:48.436210 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ee6ac388-5233-4c20-ac1e-aa31d2621579 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:48.437069 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ee6ac388-5233-4c20-ac1e-aa31d2621579 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:48.437490 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ee6ac388-5233-4c20-ac1e-aa31d2621579 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:48.583448 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ee6ac388-5233-4c20-ac1e-aa31d2621579 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:48.591642 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ee6ac388-5233-4c20-ac1e-aa31d2621579 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.167836 Sep 24 03:33:48.592316 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 225/459] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:48 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:48.804820 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4d86a5cf-99cf-49bc-8b43-bb82eeb2639c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:48.805495 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4d86a5cf-99cf-49bc-8b43-bb82eeb2639c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:48.811755 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4d86a5cf-99cf-49bc-8b43-bb82eeb2639c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:48.812198 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4d86a5cf-99cf-49bc-8b43-bb82eeb2639c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:48.812985 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4d86a5cf-99cf-49bc-8b43-bb82eeb2639c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:48.814309 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4d86a5cf-99cf-49bc-8b43-bb82eeb2639c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:48.920127 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8bb6f639-c70a-458e-bce6-27b4fde48354 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:48.920734 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8bb6f639-c70a-458e-bce6-27b4fde48354 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:48.928536 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8bb6f639-c70a-458e-bce6-27b4fde48354 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:48.928976 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8bb6f639-c70a-458e-bce6-27b4fde48354 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:48.929762 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8bb6f639-c70a-458e-bce6-27b4fde48354 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:48.930185 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8bb6f639-c70a-458e-bce6-27b4fde48354 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:48.936668 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4d86a5cf-99cf-49bc-8b43-bb82eeb2639c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:48.944545 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4d86a5cf-99cf-49bc-8b43-bb82eeb2639c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:48.946059 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4d86a5cf-99cf-49bc-8b43-bb82eeb2639c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:48.947201 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4d86a5cf-99cf-49bc-8b43-bb82eeb2639c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.146165 Sep 24 03:33:48.947753 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 235/460] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:48 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:49.070634 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8bb6f639-c70a-458e-bce6-27b4fde48354 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:49.077783 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8bb6f639-c70a-458e-bce6-27b4fde48354 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.161307 Sep 24 03:33:49.078346 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 226/461] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:48 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:49.184852 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2f32f014-0163-48a6-945b-2edd7254baf1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:49.185376 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2f32f014-0163-48a6-945b-2edd7254baf1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:49.192099 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f32f014-0163-48a6-945b-2edd7254baf1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:49.192546 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f32f014-0163-48a6-945b-2edd7254baf1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:49.193322 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f32f014-0163-48a6-945b-2edd7254baf1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:49.193774 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f32f014-0163-48a6-945b-2edd7254baf1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:49.335545 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2f32f014-0163-48a6-945b-2edd7254baf1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:49.343731 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2f32f014-0163-48a6-945b-2edd7254baf1 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.162530 Sep 24 03:33:49.353424 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 236/462] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:49 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:49.418431 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-de1e650f-be38-43e2-bb08-919cf9e8be22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:49.419063 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-de1e650f-be38-43e2-bb08-919cf9e8be22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:49.425732 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-de1e650f-be38-43e2-bb08-919cf9e8be22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:49.426179 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-de1e650f-be38-43e2-bb08-919cf9e8be22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:49.426959 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-de1e650f-be38-43e2-bb08-919cf9e8be22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:49.427404 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-de1e650f-be38-43e2-bb08-919cf9e8be22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:49.560809 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-de1e650f-be38-43e2-bb08-919cf9e8be22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:49.574659 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-de1e650f-be38-43e2-bb08-919cf9e8be22 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.159830 Sep 24 03:33:49.575248 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 227/463] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:49 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:49.608704 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-29d026dc-48e3-4b2e-9741-de3931191dda tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:49.609487 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-29d026dc-48e3-4b2e-9741-de3931191dda tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:49.616596 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-29d026dc-48e3-4b2e-9741-de3931191dda tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:49.617046 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-29d026dc-48e3-4b2e-9741-de3931191dda tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:49.617845 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-29d026dc-48e3-4b2e-9741-de3931191dda tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:49.618274 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-29d026dc-48e3-4b2e-9741-de3931191dda tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:49.747110 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-29d026dc-48e3-4b2e-9741-de3931191dda tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:49.755753 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-29d026dc-48e3-4b2e-9741-de3931191dda tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.150706 Sep 24 03:33:49.757080 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 237/464] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:49 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:49.967992 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8cf1870a-66d0-4ceb-9c12-99885eeb0c08 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:49.968613 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8cf1870a-66d0-4ceb-9c12-99885eeb0c08 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:49.974541 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8cf1870a-66d0-4ceb-9c12-99885eeb0c08 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:49.974979 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8cf1870a-66d0-4ceb-9c12-99885eeb0c08 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:49.975760 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8cf1870a-66d0-4ceb-9c12-99885eeb0c08 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:49.976178 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8cf1870a-66d0-4ceb-9c12-99885eeb0c08 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:50.095430 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5f9fa25c-38a5-40ea-93c8-3d3d9644ecea tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:50.096218 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5f9fa25c-38a5-40ea-93c8-3d3d9644ecea tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:50.102434 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8cf1870a-66d0-4ceb-9c12-99885eeb0c08 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:50.105191 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f9fa25c-38a5-40ea-93c8-3d3d9644ecea tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:50.105635 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f9fa25c-38a5-40ea-93c8-3d3d9644ecea tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:50.106474 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f9fa25c-38a5-40ea-93c8-3d3d9644ecea tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:50.106896 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f9fa25c-38a5-40ea-93c8-3d3d9644ecea tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:50.111704 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8cf1870a-66d0-4ceb-9c12-99885eeb0c08 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:50.113309 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8cf1870a-66d0-4ceb-9c12-99885eeb0c08 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:50.114780 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8cf1870a-66d0-4ceb-9c12-99885eeb0c08 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.151930 Sep 24 03:33:50.115356 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 228/465] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:49 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:50.237040 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5f9fa25c-38a5-40ea-93c8-3d3d9644ecea tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:50.244562 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5f9fa25c-38a5-40ea-93c8-3d3d9644ecea tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.153443 Sep 24 03:33:50.245127 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 238/466] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:50 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:50.370102 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-bf97d675-8b58-4ca7-97dd-c30ff2d37b2b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:50.370703 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-bf97d675-8b58-4ca7-97dd-c30ff2d37b2b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:50.377641 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bf97d675-8b58-4ca7-97dd-c30ff2d37b2b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:50.378134 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bf97d675-8b58-4ca7-97dd-c30ff2d37b2b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:50.378891 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bf97d675-8b58-4ca7-97dd-c30ff2d37b2b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:50.379319 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bf97d675-8b58-4ca7-97dd-c30ff2d37b2b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:50.507385 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-bf97d675-8b58-4ca7-97dd-c30ff2d37b2b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:50.515139 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-bf97d675-8b58-4ca7-97dd-c30ff2d37b2b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.148737 Sep 24 03:33:50.515695 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 229/467] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:50 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:50.590742 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d0034b52-8976-48c3-b286-ac5b1eabd520 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:50.591410 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d0034b52-8976-48c3-b286-ac5b1eabd520 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:50.597894 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d0034b52-8976-48c3-b286-ac5b1eabd520 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:50.598338 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d0034b52-8976-48c3-b286-ac5b1eabd520 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:50.599093 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d0034b52-8976-48c3-b286-ac5b1eabd520 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:50.599519 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d0034b52-8976-48c3-b286-ac5b1eabd520 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:50.736918 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d0034b52-8976-48c3-b286-ac5b1eabd520 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:50.746065 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d0034b52-8976-48c3-b286-ac5b1eabd520 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.158893 Sep 24 03:33:50.746829 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 239/468] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:50 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:50.772928 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8c33811e-e8dc-48d7-a9ea-14756041d187 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:50.773615 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8c33811e-e8dc-48d7-a9ea-14756041d187 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:50.779915 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8c33811e-e8dc-48d7-a9ea-14756041d187 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:50.780416 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8c33811e-e8dc-48d7-a9ea-14756041d187 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:50.781302 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8c33811e-e8dc-48d7-a9ea-14756041d187 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:50.781819 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8c33811e-e8dc-48d7-a9ea-14756041d187 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:50.907188 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8c33811e-e8dc-48d7-a9ea-14756041d187 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:50.914365 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8c33811e-e8dc-48d7-a9ea-14756041d187 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.145227 Sep 24 03:33:50.914927 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 230/469] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:50 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:51.137279 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-138839ec-fe78-48d7-9b5e-db39bb800146 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:51.138645 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-138839ec-fe78-48d7-9b5e-db39bb800146 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:51.149789 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-138839ec-fe78-48d7-9b5e-db39bb800146 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:51.151353 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-138839ec-fe78-48d7-9b5e-db39bb800146 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:51.152156 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-138839ec-fe78-48d7-9b5e-db39bb800146 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:51.153319 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-138839ec-fe78-48d7-9b5e-db39bb800146 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:51.261053 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-85598e43-33d5-48f8-8808-8742df69c089 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:51.261688 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-85598e43-33d5-48f8-8808-8742df69c089 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:51.267783 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-85598e43-33d5-48f8-8808-8742df69c089 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:51.268226 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-85598e43-33d5-48f8-8808-8742df69c089 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:51.269036 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-85598e43-33d5-48f8-8808-8742df69c089 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:51.269450 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-85598e43-33d5-48f8-8808-8742df69c089 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:51.294703 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-138839ec-fe78-48d7-9b5e-db39bb800146 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:51.305020 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-138839ec-fe78-48d7-9b5e-db39bb800146 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:51.307120 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-138839ec-fe78-48d7-9b5e-db39bb800146 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:51.308470 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-138839ec-fe78-48d7-9b5e-db39bb800146 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.176541 Sep 24 03:33:51.309578 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 240/470] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:51 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:51.413906 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-85598e43-33d5-48f8-8808-8742df69c089 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:51.421495 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-85598e43-33d5-48f8-8808-8742df69c089 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.163916 Sep 24 03:33:51.422460 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 231/471] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:51 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:51.533559 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ef27a650-8507-42b4-bc07-d5f53ecde08e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:51.534515 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ef27a650-8507-42b4-bc07-d5f53ecde08e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:51.541855 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ef27a650-8507-42b4-bc07-d5f53ecde08e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:51.542302 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ef27a650-8507-42b4-bc07-d5f53ecde08e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:51.543077 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ef27a650-8507-42b4-bc07-d5f53ecde08e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:51.543498 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ef27a650-8507-42b4-bc07-d5f53ecde08e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:51.670215 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ef27a650-8507-42b4-bc07-d5f53ecde08e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:51.681175 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ef27a650-8507-42b4-bc07-d5f53ecde08e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.151186 Sep 24 03:33:51.684583 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 241/472] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:51 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:51.770214 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-31499c3e-ba9e-40ad-a815-7868fe350e52 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:51.770884 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-31499c3e-ba9e-40ad-a815-7868fe350e52 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:51.776777 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-31499c3e-ba9e-40ad-a815-7868fe350e52 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:51.777293 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-31499c3e-ba9e-40ad-a815-7868fe350e52 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:51.778194 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-31499c3e-ba9e-40ad-a815-7868fe350e52 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:51.778691 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-31499c3e-ba9e-40ad-a815-7868fe350e52 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:51.907348 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-31499c3e-ba9e-40ad-a815-7868fe350e52 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:51.915243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-31499c3e-ba9e-40ad-a815-7868fe350e52 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.154043 Sep 24 03:33:51.915834 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 232/473] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:51 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:51.931841 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-55c1b6cf-9f1b-4f30-8853-9464684e22cf tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:51.932401 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-55c1b6cf-9f1b-4f30-8853-9464684e22cf tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:51.938299 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-55c1b6cf-9f1b-4f30-8853-9464684e22cf tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:51.938760 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-55c1b6cf-9f1b-4f30-8853-9464684e22cf tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:51.939584 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-55c1b6cf-9f1b-4f30-8853-9464684e22cf tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:51.940007 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-55c1b6cf-9f1b-4f30-8853-9464684e22cf tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:52.068993 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-55c1b6cf-9f1b-4f30-8853-9464684e22cf tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:52.076817 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-55c1b6cf-9f1b-4f30-8853-9464684e22cf tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.148544 Sep 24 03:33:52.077670 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 242/474] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:51 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:52.326063 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e65a5607-f3eb-4f25-9d91-aa13775b4a7e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:52.326657 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e65a5607-f3eb-4f25-9d91-aa13775b4a7e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:52.333135 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e65a5607-f3eb-4f25-9d91-aa13775b4a7e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:52.333566 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e65a5607-f3eb-4f25-9d91-aa13775b4a7e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:52.334528 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e65a5607-f3eb-4f25-9d91-aa13775b4a7e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:52.334951 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e65a5607-f3eb-4f25-9d91-aa13775b4a7e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:52.437873 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8a8a97f8-28e2-48ff-a1c6-cf53857bd2ee tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:52.438591 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8a8a97f8-28e2-48ff-a1c6-cf53857bd2ee tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:52.447921 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8a8a97f8-28e2-48ff-a1c6-cf53857bd2ee tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:52.448400 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8a8a97f8-28e2-48ff-a1c6-cf53857bd2ee tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:52.449219 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8a8a97f8-28e2-48ff-a1c6-cf53857bd2ee tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:52.449648 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8a8a97f8-28e2-48ff-a1c6-cf53857bd2ee tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:52.466919 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e65a5607-f3eb-4f25-9d91-aa13775b4a7e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:52.480976 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e65a5607-f3eb-4f25-9d91-aa13775b4a7e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:52.482995 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e65a5607-f3eb-4f25-9d91-aa13775b4a7e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:52.484256 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e65a5607-f3eb-4f25-9d91-aa13775b4a7e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.161894 Sep 24 03:33:52.495117 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 233/475] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:52 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:52.578563 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8a8a97f8-28e2-48ff-a1c6-cf53857bd2ee tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:52.586440 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8a8a97f8-28e2-48ff-a1c6-cf53857bd2ee tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.152097 Sep 24 03:33:52.587209 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 243/476] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:52 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:52.700977 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-7b3ce925-94cb-4dc0-b667-066ca913e195 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:52.701584 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-7b3ce925-94cb-4dc0-b667-066ca913e195 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:52.707523 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7b3ce925-94cb-4dc0-b667-066ca913e195 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:52.707965 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7b3ce925-94cb-4dc0-b667-066ca913e195 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:52.708725 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7b3ce925-94cb-4dc0-b667-066ca913e195 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:52.709152 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7b3ce925-94cb-4dc0-b667-066ca913e195 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:52.843020 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-7b3ce925-94cb-4dc0-b667-066ca913e195 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:52.853655 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-7b3ce925-94cb-4dc0-b667-066ca913e195 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.156153 Sep 24 03:33:52.854261 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 234/477] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:52 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:52.932185 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b6c9a830-77be-4dca-afc0-c9130caa4386 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:52.932797 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b6c9a830-77be-4dca-afc0-c9130caa4386 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:52.938923 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b6c9a830-77be-4dca-afc0-c9130caa4386 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:52.939372 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b6c9a830-77be-4dca-afc0-c9130caa4386 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:52.940139 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b6c9a830-77be-4dca-afc0-c9130caa4386 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:52.940568 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b6c9a830-77be-4dca-afc0-c9130caa4386 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:53.077323 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b6c9a830-77be-4dca-afc0-c9130caa4386 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:53.088530 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b6c9a830-77be-4dca-afc0-c9130caa4386 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.158924 Sep 24 03:33:53.088530 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 244/478] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:52 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:53.102821 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-86c7b4c3-8413-408c-8dc1-ba5a457975d1 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:53.103499 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-86c7b4c3-8413-408c-8dc1-ba5a457975d1 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:53.109378 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-86c7b4c3-8413-408c-8dc1-ba5a457975d1 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:53.109847 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-86c7b4c3-8413-408c-8dc1-ba5a457975d1 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:53.111321 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-86c7b4c3-8413-408c-8dc1-ba5a457975d1 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:53.111745 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-86c7b4c3-8413-408c-8dc1-ba5a457975d1 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:53.233917 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-86c7b4c3-8413-408c-8dc1-ba5a457975d1 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:53.241814 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-86c7b4c3-8413-408c-8dc1-ba5a457975d1 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.142715 Sep 24 03:33:53.242383 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 235/479] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:53 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:53.505590 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3a5207dd-660f-423f-a70b-394fed57e0b1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:53.506268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3a5207dd-660f-423f-a70b-394fed57e0b1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:53.514165 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3a5207dd-660f-423f-a70b-394fed57e0b1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:53.514606 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3a5207dd-660f-423f-a70b-394fed57e0b1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:53.515380 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3a5207dd-660f-423f-a70b-394fed57e0b1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:53.515806 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3a5207dd-660f-423f-a70b-394fed57e0b1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:53.602803 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1d37da0c-06e2-49ed-8089-34e3656540ab tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:53.603570 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1d37da0c-06e2-49ed-8089-34e3656540ab tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:53.615600 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1d37da0c-06e2-49ed-8089-34e3656540ab tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:53.616046 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1d37da0c-06e2-49ed-8089-34e3656540ab tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:53.616880 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1d37da0c-06e2-49ed-8089-34e3656540ab tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:53.617258 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1d37da0c-06e2-49ed-8089-34e3656540ab tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:53.647232 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3a5207dd-660f-423f-a70b-394fed57e0b1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:53.655070 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3a5207dd-660f-423f-a70b-394fed57e0b1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:53.656575 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3a5207dd-660f-423f-a70b-394fed57e0b1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:53.658460 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3a5207dd-660f-423f-a70b-394fed57e0b1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.159572 Sep 24 03:33:53.659032 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 245/480] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:53 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:53.758035 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1d37da0c-06e2-49ed-8089-34e3656540ab tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:53.765454 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1d37da0c-06e2-49ed-8089-34e3656540ab tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.166234 Sep 24 03:33:53.766051 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 236/481] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:53 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:53.870496 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-39750905-2e53-4d3f-abb7-2a445224f12f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:53.871095 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-39750905-2e53-4d3f-abb7-2a445224f12f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:53.877593 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-39750905-2e53-4d3f-abb7-2a445224f12f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:53.878254 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-39750905-2e53-4d3f-abb7-2a445224f12f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:53.879049 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-39750905-2e53-4d3f-abb7-2a445224f12f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:53.879483 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-39750905-2e53-4d3f-abb7-2a445224f12f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:54.007619 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-39750905-2e53-4d3f-abb7-2a445224f12f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:54.015500 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-39750905-2e53-4d3f-abb7-2a445224f12f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.148557 Sep 24 03:33:54.016044 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 246/482] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:53 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:54.105442 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-980ae319-605a-41d0-af23-28b17c2f1e67 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:54.106090 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-980ae319-605a-41d0-af23-28b17c2f1e67 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:54.112013 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-980ae319-605a-41d0-af23-28b17c2f1e67 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:54.112454 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-980ae319-605a-41d0-af23-28b17c2f1e67 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:54.113218 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-980ae319-605a-41d0-af23-28b17c2f1e67 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:54.113649 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-980ae319-605a-41d0-af23-28b17c2f1e67 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:54.240159 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-980ae319-605a-41d0-af23-28b17c2f1e67 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:54.247800 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-980ae319-605a-41d0-af23-28b17c2f1e67 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.146056 Sep 24 03:33:54.248357 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 237/483] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:54 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:54.258671 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-da7ac1eb-e099-442b-b6de-cb60737f42d4 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:54.259269 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-da7ac1eb-e099-442b-b6de-cb60737f42d4 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:54.265201 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-da7ac1eb-e099-442b-b6de-cb60737f42d4 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:54.265687 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-da7ac1eb-e099-442b-b6de-cb60737f42d4 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:54.267054 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-da7ac1eb-e099-442b-b6de-cb60737f42d4 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:54.267473 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-da7ac1eb-e099-442b-b6de-cb60737f42d4 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:54.387926 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-da7ac1eb-e099-442b-b6de-cb60737f42d4 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:54.395706 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-da7ac1eb-e099-442b-b6de-cb60737f42d4 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.140567 Sep 24 03:33:54.396272 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 247/484] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:54 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:54.677028 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2ad1f1a3-46d0-49ee-8618-fec15eaccb66 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:54.677547 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2ad1f1a3-46d0-49ee-8618-fec15eaccb66 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:54.683471 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2ad1f1a3-46d0-49ee-8618-fec15eaccb66 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:54.683907 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2ad1f1a3-46d0-49ee-8618-fec15eaccb66 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:54.684655 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2ad1f1a3-46d0-49ee-8618-fec15eaccb66 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:54.685074 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2ad1f1a3-46d0-49ee-8618-fec15eaccb66 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:54.787667 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6cdade13-f8f6-4a97-9122-63fbc93d1893 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:54.788720 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6cdade13-f8f6-4a97-9122-63fbc93d1893 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:54.794973 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6cdade13-f8f6-4a97-9122-63fbc93d1893 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:54.795782 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6cdade13-f8f6-4a97-9122-63fbc93d1893 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:54.796658 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6cdade13-f8f6-4a97-9122-63fbc93d1893 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:54.797193 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6cdade13-f8f6-4a97-9122-63fbc93d1893 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:54.808492 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2ad1f1a3-46d0-49ee-8618-fec15eaccb66 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:54.817358 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2ad1f1a3-46d0-49ee-8618-fec15eaccb66 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:54.819724 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2ad1f1a3-46d0-49ee-8618-fec15eaccb66 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:54.821606 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2ad1f1a3-46d0-49ee-8618-fec15eaccb66 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.148710 Sep 24 03:33:54.822744 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 238/485] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:54 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:54.930174 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6cdade13-f8f6-4a97-9122-63fbc93d1893 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:54.937525 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6cdade13-f8f6-4a97-9122-63fbc93d1893 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.155149 Sep 24 03:33:54.938332 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 248/486] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:54 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:55.033609 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c4b146b2-01ff-4080-982d-00e1bfb0dbcb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:55.034615 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c4b146b2-01ff-4080-982d-00e1bfb0dbcb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:55.041115 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c4b146b2-01ff-4080-982d-00e1bfb0dbcb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:55.041696 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c4b146b2-01ff-4080-982d-00e1bfb0dbcb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:55.042603 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c4b146b2-01ff-4080-982d-00e1bfb0dbcb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:55.043143 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c4b146b2-01ff-4080-982d-00e1bfb0dbcb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:55.167786 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c4b146b2-01ff-4080-982d-00e1bfb0dbcb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:55.176543 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c4b146b2-01ff-4080-982d-00e1bfb0dbcb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.147443 Sep 24 03:33:55.177123 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 239/487] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:55 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:55.265257 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c7aee1cf-403b-4bf4-becd-eb6728b76a7c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:55.265892 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c7aee1cf-403b-4bf4-becd-eb6728b76a7c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:55.272546 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7aee1cf-403b-4bf4-becd-eb6728b76a7c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:55.272995 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7aee1cf-403b-4bf4-becd-eb6728b76a7c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:55.273786 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7aee1cf-403b-4bf4-becd-eb6728b76a7c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:55.274217 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7aee1cf-403b-4bf4-becd-eb6728b76a7c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:55.400682 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c7aee1cf-403b-4bf4-becd-eb6728b76a7c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:55.409248 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c7aee1cf-403b-4bf4-becd-eb6728b76a7c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.147636 Sep 24 03:33:55.409836 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 249/488] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:55 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:55.412915 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-97f2d5d9-3780-4750-b7ca-cff14cab7767 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:55.413514 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-97f2d5d9-3780-4750-b7ca-cff14cab7767 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:55.419292 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-97f2d5d9-3780-4750-b7ca-cff14cab7767 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:55.419727 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-97f2d5d9-3780-4750-b7ca-cff14cab7767 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:55.420477 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-97f2d5d9-3780-4750-b7ca-cff14cab7767 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:55.420898 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-97f2d5d9-3780-4750-b7ca-cff14cab7767 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:55.546111 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-97f2d5d9-3780-4750-b7ca-cff14cab7767 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:55.553985 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-97f2d5d9-3780-4750-b7ca-cff14cab7767 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.144946 Sep 24 03:33:55.554565 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 240/489] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:55 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:55.840428 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1a48b148-b6b8-4d2c-8164-5895b34d2e15 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:55.840934 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1a48b148-b6b8-4d2c-8164-5895b34d2e15 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:55.848138 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1a48b148-b6b8-4d2c-8164-5895b34d2e15 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:55.848576 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1a48b148-b6b8-4d2c-8164-5895b34d2e15 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:55.849683 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1a48b148-b6b8-4d2c-8164-5895b34d2e15 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:55.850207 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1a48b148-b6b8-4d2c-8164-5895b34d2e15 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:55.954438 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8ac56f8e-57bc-423e-996c-d9404f91e291 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:55.956036 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8ac56f8e-57bc-423e-996c-d9404f91e291 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:55.962427 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ac56f8e-57bc-423e-996c-d9404f91e291 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:55.962966 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ac56f8e-57bc-423e-996c-d9404f91e291 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:55.963754 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ac56f8e-57bc-423e-996c-d9404f91e291 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:55.964293 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ac56f8e-57bc-423e-996c-d9404f91e291 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:55.975956 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1a48b148-b6b8-4d2c-8164-5895b34d2e15 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:55.983762 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1a48b148-b6b8-4d2c-8164-5895b34d2e15 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:55.985259 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1a48b148-b6b8-4d2c-8164-5895b34d2e15 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:55.987024 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1a48b148-b6b8-4d2c-8164-5895b34d2e15 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.150535 Sep 24 03:33:55.987592 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 250/490] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:55 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:56.086471 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8ac56f8e-57bc-423e-996c-d9404f91e291 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:56.093675 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8ac56f8e-57bc-423e-996c-d9404f91e291 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.143318 Sep 24 03:33:56.094212 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 241/491] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:55 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:56.194860 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f1f44804-54da-458f-b5f6-1eb3b4d5f20b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:56.195450 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f1f44804-54da-458f-b5f6-1eb3b4d5f20b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:56.201419 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f1f44804-54da-458f-b5f6-1eb3b4d5f20b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:56.201893 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f1f44804-54da-458f-b5f6-1eb3b4d5f20b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:56.202651 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f1f44804-54da-458f-b5f6-1eb3b4d5f20b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:56.203071 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f1f44804-54da-458f-b5f6-1eb3b4d5f20b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:56.324485 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-f1f44804-54da-458f-b5f6-1eb3b4d5f20b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:56.332865 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f1f44804-54da-458f-b5f6-1eb3b4d5f20b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.141700 Sep 24 03:33:56.333424 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 251/492] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:56 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:56.426022 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-4843c9e2-6ede-494b-a4e2-556e94f15397 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:56.426629 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-4843c9e2-6ede-494b-a4e2-556e94f15397 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:56.432404 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4843c9e2-6ede-494b-a4e2-556e94f15397 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:56.432843 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4843c9e2-6ede-494b-a4e2-556e94f15397 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:56.433600 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4843c9e2-6ede-494b-a4e2-556e94f15397 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:56.434047 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4843c9e2-6ede-494b-a4e2-556e94f15397 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:56.558132 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4843c9e2-6ede-494b-a4e2-556e94f15397 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:56.566021 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-4843c9e2-6ede-494b-a4e2-556e94f15397 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1721 microversion: 2.1 time: 0.143834 Sep 24 03:33:56.566591 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 242/493] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:56 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:56.570650 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a19f3fd5-7574-4615-baef-20dbbddefa69 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:56.571252 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a19f3fd5-7574-4615-baef-20dbbddefa69 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:56.577066 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a19f3fd5-7574-4615-baef-20dbbddefa69 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:56.577507 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a19f3fd5-7574-4615-baef-20dbbddefa69 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:56.578285 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a19f3fd5-7574-4615-baef-20dbbddefa69 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:56.578709 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a19f3fd5-7574-4615-baef-20dbbddefa69 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:56.703189 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a19f3fd5-7574-4615-baef-20dbbddefa69 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:56.710424 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a19f3fd5-7574-4615-baef-20dbbddefa69 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.143545 Sep 24 03:33:56.710994 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 252/494] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:56 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:57.005318 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9c397a64-0172-4c53-bc2b-cd2778521ec8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:57.006459 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9c397a64-0172-4c53-bc2b-cd2778521ec8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:57.012752 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c397a64-0172-4c53-bc2b-cd2778521ec8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.013191 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c397a64-0172-4c53-bc2b-cd2778521ec8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:57.013990 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c397a64-0172-4c53-bc2b-cd2778521ec8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.014417 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c397a64-0172-4c53-bc2b-cd2778521ec8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:57.109995 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5e4bb722-df40-442e-ad04-7d1d6d39d205 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:57.111305 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5e4bb722-df40-442e-ad04-7d1d6d39d205 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:57.120394 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5e4bb722-df40-442e-ad04-7d1d6d39d205 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.120975 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5e4bb722-df40-442e-ad04-7d1d6d39d205 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:57.121890 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5e4bb722-df40-442e-ad04-7d1d6d39d205 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.122530 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5e4bb722-df40-442e-ad04-7d1d6d39d205 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:57.225977 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9c397a64-0172-4c53-bc2b-cd2778521ec8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:57.236204 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9c397a64-0172-4c53-bc2b-cd2778521ec8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:57.238417 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9c397a64-0172-4c53-bc2b-cd2778521ec8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:57.242749 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9c397a64-0172-4c53-bc2b-cd2778521ec8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.241830 Sep 24 03:33:57.253896 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 243/495] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:56 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:57.287802 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5e4bb722-df40-442e-ad04-7d1d6d39d205 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:57.290459 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-498753dc-5da7-49ff-a6f2-41df6d47efba req-5df0529e-a3c2-4ba0-ac8e-3bc1e81d5b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f970df3c-ce7a-4c9c-9564-0a3707e53696", "tag": "e6ac50dd-759d-45ec-baea-edee8c9c243d"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:57.292066 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:33:57.292066 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:33:57.296234 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5e4bb722-df40-442e-ad04-7d1d6d39d205 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.189843 Sep 24 03:33:57.297342 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 253/496] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:57 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:57.300306 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-498753dc-5da7-49ff-a6f2-41df6d47efba req-5df0529e-a3c2-4ba0-ac8e-3bc1e81d5b5e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.300749 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-498753dc-5da7-49ff-a6f2-41df6d47efba req-5df0529e-a3c2-4ba0-ac8e-3bc1e81d5b5e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:57.312405 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-498753dc-5da7-49ff-a6f2-41df6d47efba req-5df0529e-a3c2-4ba0-ac8e-3bc1e81d5b5e service nova] Creating event network-changed:e6ac50dd-759d-45ec-baea-edee8c9c243d for instance f970df3c-ce7a-4c9c-9564-0a3707e53696 on hv-cinder-81080 Sep 24 03:33:57.317955 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-498753dc-5da7-49ff-a6f2-41df6d47efba req-5df0529e-a3c2-4ba0-ac8e-3bc1e81d5b5e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031327 Sep 24 03:33:57.318547 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 244/497] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:33:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:33:57.349116 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-08039c32-6aa5-46c2-a43c-f874a575fe4e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:57.349735 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-08039c32-6aa5-46c2-a43c-f874a575fe4e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:57.355987 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-08039c32-6aa5-46c2-a43c-f874a575fe4e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.356437 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-08039c32-6aa5-46c2-a43c-f874a575fe4e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:57.357205 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-08039c32-6aa5-46c2-a43c-f874a575fe4e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.357629 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-08039c32-6aa5-46c2-a43c-f874a575fe4e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:57.488180 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-08039c32-6aa5-46c2-a43c-f874a575fe4e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:57.496109 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-08039c32-6aa5-46c2-a43c-f874a575fe4e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.151317 Sep 24 03:33:57.496673 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 254/498] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:57 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:57.591086 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-34273c0a-c5b0-4904-b527-4e56b48dc859 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:57.594204 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-34273c0a-c5b0-4904-b527-4e56b48dc859 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:57.600635 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-34273c0a-c5b0-4904-b527-4e56b48dc859 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.601087 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-34273c0a-c5b0-4904-b527-4e56b48dc859 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:57.601925 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-34273c0a-c5b0-4904-b527-4e56b48dc859 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.602957 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-34273c0a-c5b0-4904-b527-4e56b48dc859 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:57.726899 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9f8d44ea-31e7-43f9-9727-ac92c3082c61 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:57.727747 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9f8d44ea-31e7-43f9-9727-ac92c3082c61 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:57.733747 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9f8d44ea-31e7-43f9-9727-ac92c3082c61 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.733904 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-34273c0a-c5b0-4904-b527-4e56b48dc859 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:57.734195 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9f8d44ea-31e7-43f9-9727-ac92c3082c61 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:57.734958 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9f8d44ea-31e7-43f9-9727-ac92c3082c61 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.735381 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9f8d44ea-31e7-43f9-9727-ac92c3082c61 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:57.743985 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-34273c0a-c5b0-4904-b527-4e56b48dc859 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1698 microversion: 2.1 time: 0.163884 Sep 24 03:33:57.744780 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 245/499] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:57 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:57.761018 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f6eecda8-d6c7-4e67-bc7a-1353e9474615 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:33:57.769061 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f6eecda8-d6c7-4e67-bc7a-1353e9474615 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.769842 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f6eecda8-d6c7-4e67-bc7a-1353e9474615 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:57.837577 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f6eecda8-d6c7-4e67-bc7a-1353e9474615 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Going to try to start instance {{(pid=109375) start /opt/stack/nova/nova/compute/api.py:2675}} Sep 24 03:33:57.871268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-9f8d44ea-31e7-43f9-9727-ac92c3082c61 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:57.879571 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9f8d44ea-31e7-43f9-9727-ac92c3082c61 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1313 microversion: 2.1 time: 0.156137 Sep 24 03:33:57.880156 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 255/500] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:57 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:57.891132 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f6eecda8-d6c7-4e67-bc7a-1353e9474615 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 202 len: 0 microversion: 2.1 time: 0.134226 Sep 24 03:33:57.891755 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 246/501] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:33:57 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:33:57.900168 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b2326b26-70b8-4c8a-b392-8f6e875daa69 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:57.900769 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b2326b26-70b8-4c8a-b392-8f6e875daa69 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:57.907039 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b2326b26-70b8-4c8a-b392-8f6e875daa69 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.908316 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b2326b26-70b8-4c8a-b392-8f6e875daa69 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:57.909465 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b2326b26-70b8-4c8a-b392-8f6e875daa69 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:57.910073 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b2326b26-70b8-4c8a-b392-8f6e875daa69 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:58.081972 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b2326b26-70b8-4c8a-b392-8f6e875daa69 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:58.091471 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b2326b26-70b8-4c8a-b392-8f6e875daa69 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1707 microversion: 2.1 time: 0.194900 Sep 24 03:33:58.092288 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 256/502] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:57 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1707 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:58.261338 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9bf7fa1a-8d7a-4b00-b38b-10d598b51ca3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:58.262301 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9bf7fa1a-8d7a-4b00-b38b-10d598b51ca3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:58.270106 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9bf7fa1a-8d7a-4b00-b38b-10d598b51ca3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:58.270687 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9bf7fa1a-8d7a-4b00-b38b-10d598b51ca3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:58.272271 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9bf7fa1a-8d7a-4b00-b38b-10d598b51ca3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:58.272875 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9bf7fa1a-8d7a-4b00-b38b-10d598b51ca3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:58.315632 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-925a2a5b-b7f3-4862-9146-23edf76a0f29 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:58.316561 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-925a2a5b-b7f3-4862-9146-23edf76a0f29 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:58.322744 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-925a2a5b-b7f3-4862-9146-23edf76a0f29 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:58.323341 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-925a2a5b-b7f3-4862-9146-23edf76a0f29 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:58.324129 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-925a2a5b-b7f3-4862-9146-23edf76a0f29 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:58.324559 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-925a2a5b-b7f3-4862-9146-23edf76a0f29 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:58.667849 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-925a2a5b-b7f3-4862-9146-23edf76a0f29 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:58.670770 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9bf7fa1a-8d7a-4b00-b38b-10d598b51ca3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:58.676909 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-925a2a5b-b7f3-4862-9146-23edf76a0f29 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.366836 Sep 24 03:33:58.686115 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 257/503] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:58 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:58.686326 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9bf7fa1a-8d7a-4b00-b38b-10d598b51ca3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:58.686326 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9bf7fa1a-8d7a-4b00-b38b-10d598b51ca3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:58.686326 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9bf7fa1a-8d7a-4b00-b38b-10d598b51ca3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1741 microversion: 2.20 time: 0.425413 Sep 24 03:33:58.686671 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8be09d84-bf40-4112-a685-9271ee9757f7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:58.686671 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8be09d84-bf40-4112-a685-9271ee9757f7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:58.686856 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 247/504] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:58 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1741 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:33:58.690353 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8be09d84-bf40-4112-a685-9271ee9757f7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:58.690791 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8be09d84-bf40-4112-a685-9271ee9757f7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:58.691549 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8be09d84-bf40-4112-a685-9271ee9757f7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:58.691967 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8be09d84-bf40-4112-a685-9271ee9757f7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:58.899883 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a445bf5f-914d-4633-878a-9e0d57d29f1c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:58.901159 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a445bf5f-914d-4633-878a-9e0d57d29f1c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:58.913690 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8be09d84-bf40-4112-a685-9271ee9757f7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:58.920613 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a445bf5f-914d-4633-878a-9e0d57d29f1c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:58.921056 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a445bf5f-914d-4633-878a-9e0d57d29f1c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:58.921868 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a445bf5f-914d-4633-878a-9e0d57d29f1c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:58.922661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a445bf5f-914d-4633-878a-9e0d57d29f1c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:58.933016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8be09d84-bf40-4112-a685-9271ee9757f7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.253915 Sep 24 03:33:58.934943 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 258/505] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:58 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:59.067645 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a445bf5f-914d-4633-878a-9e0d57d29f1c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:59.074959 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a445bf5f-914d-4633-878a-9e0d57d29f1c tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1497 microversion: 2.1 time: 0.179817 Sep 24 03:33:59.075526 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 248/506] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:58 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:33:59.107863 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1e805d50-42ea-484f-9d74-146383479e25 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:59.108456 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1e805d50-42ea-484f-9d74-146383479e25 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:59.115675 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1e805d50-42ea-484f-9d74-146383479e25 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.115823 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1e805d50-42ea-484f-9d74-146383479e25 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.116531 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1e805d50-42ea-484f-9d74-146383479e25 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.116950 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1e805d50-42ea-484f-9d74-146383479e25 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.252709 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1e805d50-42ea-484f-9d74-146383479e25 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:59.260677 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1e805d50-42ea-484f-9d74-146383479e25 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1707 microversion: 2.1 time: 0.156406 Sep 24 03:33:59.261310 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 259/507] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:59 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1707 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:59.429590 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-598d6ef0-bfa4-4c03-a9de-b1889212be2b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:59.430113 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-598d6ef0-bfa4-4c03-a9de-b1889212be2b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:59.436183 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-598d6ef0-bfa4-4c03-a9de-b1889212be2b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.436852 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-598d6ef0-bfa4-4c03-a9de-b1889212be2b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.437622 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-598d6ef0-bfa4-4c03-a9de-b1889212be2b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.438084 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-598d6ef0-bfa4-4c03-a9de-b1889212be2b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.521367 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-598d6ef0-bfa4-4c03-a9de-b1889212be2b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lazy-loading 'services' on Instance uuid e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:33:59.587673 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-598d6ef0-bfa4-4c03-a9de-b1889212be2b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc/os-volume_attachments/aa6cde37-6e34-468e-9482-c2f76b475d97" status: 202 len: 0 microversion: 2.1 time: 0.161698 Sep 24 03:33:59.588449 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 249/508] 10.222.0.18 () {58 vars in 1416 bytes} [Fri Sep 24 03:33:59 2021] DELETE /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc/os-volume_attachments/aa6cde37-6e34-468e-9482-c2f76b475d97 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:33:59.598048 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9a720759-757d-4a32-9e1e-95557fda4fd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:59.599066 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9a720759-757d-4a32-9e1e-95557fda4fd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:59.604892 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9a720759-757d-4a32-9e1e-95557fda4fd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.605578 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9a720759-757d-4a32-9e1e-95557fda4fd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.606466 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9a720759-757d-4a32-9e1e-95557fda4fd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.606962 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9a720759-757d-4a32-9e1e-95557fda4fd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.639806 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9a720759-757d-4a32-9e1e-95557fda4fd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046845 Sep 24 03:33:59.640504 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 260/509] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:33:59 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:33:59.681148 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-0ee02998-8c3e-4e14-94bf-8659689c5550 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:59.681749 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-0ee02998-8c3e-4e14-94bf-8659689c5550 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:59.687710 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0ee02998-8c3e-4e14-94bf-8659689c5550 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.688230 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0ee02998-8c3e-4e14-94bf-8659689c5550 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.689821 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0ee02998-8c3e-4e14-94bf-8659689c5550 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.690259 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0ee02998-8c3e-4e14-94bf-8659689c5550 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.694368 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0bd81804-e36d-435a-b809-5c0d670c4680 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:59.695074 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0bd81804-e36d-435a-b809-5c0d670c4680 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:59.701945 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0bd81804-e36d-435a-b809-5c0d670c4680 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.702339 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0bd81804-e36d-435a-b809-5c0d670c4680 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.703438 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0bd81804-e36d-435a-b809-5c0d670c4680 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.703875 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0bd81804-e36d-435a-b809-5c0d670c4680 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.716918 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-0ee02998-8c3e-4e14-94bf-8659689c5550 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Going to try to terminate instance {{(pid=109375) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:33:59.802156 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-0ee02998-8c3e-4e14-94bf-8659689c5550 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "DELETE /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 204 len: 0 microversion: 2.1 time: 0.124568 Sep 24 03:33:59.802769 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 250/510] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:33:59 2021] DELETE /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:33:59.810847 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-0b06e2e5-e390-42b3-9438-93964fb0aeca tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:59.811535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-0b06e2e5-e390-42b3-9438-93964fb0aeca tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:59.817535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0b06e2e5-e390-42b3-9438-93964fb0aeca tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.818013 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0b06e2e5-e390-42b3-9438-93964fb0aeca tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.818784 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0b06e2e5-e390-42b3-9438-93964fb0aeca tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.819209 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0b06e2e5-e390-42b3-9438-93964fb0aeca tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.834393 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0bd81804-e36d-435a-b809-5c0d670c4680 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:59.841519 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0bd81804-e36d-435a-b809-5c0d670c4680 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.151778 Sep 24 03:33:59.842118 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 261/511] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:59 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:33:59.847040 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8dbe2dca-2d0a-423f-a67c-b5eb4d7db88d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:33:59.847631 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8dbe2dca-2d0a-423f-a67c-b5eb4d7db88d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:33:59.853591 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8dbe2dca-2d0a-423f-a67c-b5eb4d7db88d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.853994 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8dbe2dca-2d0a-423f-a67c-b5eb4d7db88d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.854747 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8dbe2dca-2d0a-423f-a67c-b5eb4d7db88d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:33:59.855166 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8dbe2dca-2d0a-423f-a67c-b5eb4d7db88d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:33:59.978658 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-0b06e2e5-e390-42b3-9438-93964fb0aeca tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:59.987227 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-0b06e2e5-e390-42b3-9438-93964fb0aeca tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:59.988981 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-0b06e2e5-e390-42b3-9438-93964fb0aeca tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:33:59.990189 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-0b06e2e5-e390-42b3-9438-93964fb0aeca tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1741 microversion: 2.20 time: 0.183307 Sep 24 03:33:59.990748 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 251/512] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:33:59 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:00.002895 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a3d85945-1fb6-4083-8b5b-3a38c0c5aa88 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:00.003489 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a3d85945-1fb6-4083-8b5b-3a38c0c5aa88 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:00.009296 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a3d85945-1fb6-4083-8b5b-3a38c0c5aa88 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:00.009761 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a3d85945-1fb6-4083-8b5b-3a38c0c5aa88 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:00.010543 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a3d85945-1fb6-4083-8b5b-3a38c0c5aa88 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:00.010966 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a3d85945-1fb6-4083-8b5b-3a38c0c5aa88 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:00.014072 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8dbe2dca-2d0a-423f-a67c-b5eb4d7db88d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:00.022134 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8dbe2dca-2d0a-423f-a67c-b5eb4d7db88d tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1503 microversion: 2.1 time: 0.179048 Sep 24 03:34:00.022710 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 262/513] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:59 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:00.131655 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a3d85945-1fb6-4083-8b5b-3a38c0c5aa88 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:00.139309 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a3d85945-1fb6-4083-8b5b-3a38c0c5aa88 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.147632 Sep 24 03:34:00.139874 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 252/514] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:33:59 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:00.278255 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5aa6aeb6-4845-42a9-a891-d5e7b519a3f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:00.278963 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5aa6aeb6-4845-42a9-a891-d5e7b519a3f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:00.284844 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5aa6aeb6-4845-42a9-a891-d5e7b519a3f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:00.285280 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5aa6aeb6-4845-42a9-a891-d5e7b519a3f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:00.286060 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5aa6aeb6-4845-42a9-a891-d5e7b519a3f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:00.286482 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5aa6aeb6-4845-42a9-a891-d5e7b519a3f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:00.411598 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5aa6aeb6-4845-42a9-a891-d5e7b519a3f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:00.419388 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5aa6aeb6-4845-42a9-a891-d5e7b519a3f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1707 microversion: 2.1 time: 0.144763 Sep 24 03:34:00.419957 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 263/515] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:00 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1707 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:00.651185 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b423eae7-cd8b-46a1-b999-58e7d146523f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:00.652125 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b423eae7-cd8b-46a1-b999-58e7d146523f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:00.659089 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b423eae7-cd8b-46a1-b999-58e7d146523f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:00.659499 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b423eae7-cd8b-46a1-b999-58e7d146523f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:00.660293 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b423eae7-cd8b-46a1-b999-58e7d146523f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:00.660705 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b423eae7-cd8b-46a1-b999-58e7d146523f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:00.691145 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b423eae7-cd8b-46a1-b999-58e7d146523f tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043780 Sep 24 03:34:00.695155 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 253/516] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:34:00 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:00.750230 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-d2bfcb94-8c59-4418-aad7-6d18752575b7 req-eb54b7a2-6dfc-429b-b59b-c8fa202feb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f043b14-af6f-4d95-a094-87fa6c768493", "name": "network-vif-plugged", "status": "completed", "tag": "67582d29-a79f-4ee2-8844-18b26e15268b"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:00.751800 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:00.751800 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:34:00.758562 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-d2bfcb94-8c59-4418-aad7-6d18752575b7 req-eb54b7a2-6dfc-429b-b59b-c8fa202feb2b service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:00.759000 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-d2bfcb94-8c59-4418-aad7-6d18752575b7 req-eb54b7a2-6dfc-429b-b59b-c8fa202feb2b service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:00.773965 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-d2bfcb94-8c59-4418-aad7-6d18752575b7 req-eb54b7a2-6dfc-429b-b59b-c8fa202feb2b service nova] Creating event network-vif-plugged:67582d29-a79f-4ee2-8844-18b26e15268b for instance 3f043b14-af6f-4d95-a094-87fa6c768493 on hv-cinder-81080 Sep 24 03:34:00.779386 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-d2bfcb94-8c59-4418-aad7-6d18752575b7 req-eb54b7a2-6dfc-429b-b59b-c8fa202feb2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032713 Sep 24 03:34:00.779970 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 264/517] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:34:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:00.858003 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-bee54318-b24b-4379-904a-567667b58669 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:00.858613 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-bee54318-b24b-4379-904a-567667b58669 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:00.865250 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bee54318-b24b-4379-904a-567667b58669 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:00.865689 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bee54318-b24b-4379-904a-567667b58669 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:00.866479 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bee54318-b24b-4379-904a-567667b58669 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:00.866903 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bee54318-b24b-4379-904a-567667b58669 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:00.983571 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-bee54318-b24b-4379-904a-567667b58669 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:00.991599 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-bee54318-b24b-4379-904a-567667b58669 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.137215 Sep 24 03:34:00.992166 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 254/518] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:00 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:01.008369 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-637738b4-edb4-45ff-902a-6d8a75f050ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:01.009051 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-637738b4-edb4-45ff-902a-6d8a75f050ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:01.015096 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-637738b4-edb4-45ff-902a-6d8a75f050ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:01.015538 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-637738b4-edb4-45ff-902a-6d8a75f050ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:01.016298 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-637738b4-edb4-45ff-902a-6d8a75f050ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:01.016722 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-637738b4-edb4-45ff-902a-6d8a75f050ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:01.039139 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-08e5013f-16d4-456b-9c65-cdf6ca6c316e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:01.039737 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-08e5013f-16d4-456b-9c65-cdf6ca6c316e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:01.045382 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-08e5013f-16d4-456b-9c65-cdf6ca6c316e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:01.045842 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-08e5013f-16d4-456b-9c65-cdf6ca6c316e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:01.046593 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-08e5013f-16d4-456b-9c65-cdf6ca6c316e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:01.047010 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-08e5013f-16d4-456b-9c65-cdf6ca6c316e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:01.196972 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-637738b4-edb4-45ff-902a-6d8a75f050ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:01.201559 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-08e5013f-16d4-456b-9c65-cdf6ca6c316e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:01.206485 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-637738b4-edb4-45ff-902a-6d8a75f050ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:01.208009 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-637738b4-edb4-45ff-902a-6d8a75f050ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:01.209304 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-637738b4-edb4-45ff-902a-6d8a75f050ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1741 microversion: 2.20 time: 0.205016 Sep 24 03:34:01.209630 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-08e5013f-16d4-456b-9c65-cdf6ca6c316e tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1503 microversion: 2.1 time: 0.173979 Sep 24 03:34:01.210209 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 265/519] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:01 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:01.210487 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 255/520] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:01 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:01.214562 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5f785b3d-5b01-4a00-a31a-22891c621ec4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:01.215210 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5f785b3d-5b01-4a00-a31a-22891c621ec4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:01.221153 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f785b3d-5b01-4a00-a31a-22891c621ec4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:01.221601 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f785b3d-5b01-4a00-a31a-22891c621ec4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:01.222424 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f785b3d-5b01-4a00-a31a-22891c621ec4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:01.222868 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f785b3d-5b01-4a00-a31a-22891c621ec4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:01.342843 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5f785b3d-5b01-4a00-a31a-22891c621ec4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:01.350742 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5f785b3d-5b01-4a00-a31a-22891c621ec4 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.139731 Sep 24 03:34:01.351305 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 266/521] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:01 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:01.435280 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-74098859-f8e8-4d0b-b581-c02ec3a2096b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:01.436001 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-74098859-f8e8-4d0b-b581-c02ec3a2096b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:01.442857 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-74098859-f8e8-4d0b-b581-c02ec3a2096b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:01.443290 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-74098859-f8e8-4d0b-b581-c02ec3a2096b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:01.444037 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-74098859-f8e8-4d0b-b581-c02ec3a2096b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:01.444511 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-74098859-f8e8-4d0b-b581-c02ec3a2096b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:01.560466 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-74098859-f8e8-4d0b-b581-c02ec3a2096b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:01.568267 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-74098859-f8e8-4d0b-b581-c02ec3a2096b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1711 microversion: 2.1 time: 0.136587 Sep 24 03:34:01.569095 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 256/522] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:01 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1711 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:01.702558 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3f7100dd-0e74-40fd-a986-b66f4da74354 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:01.703394 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3f7100dd-0e74-40fd-a986-b66f4da74354 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:01.709915 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3f7100dd-0e74-40fd-a986-b66f4da74354 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:01.710359 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3f7100dd-0e74-40fd-a986-b66f4da74354 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:01.711121 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3f7100dd-0e74-40fd-a986-b66f4da74354 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:01.711546 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3f7100dd-0e74-40fd-a986-b66f4da74354 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:01.740102 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3f7100dd-0e74-40fd-a986-b66f4da74354 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041263 Sep 24 03:34:01.740623 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 267/523] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:34:01 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:34:02.007688 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c3e76eeb-de96-4dee-98f8-b888da45372b tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:02.008424 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c3e76eeb-de96-4dee-98f8-b888da45372b tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:02.014539 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c3e76eeb-de96-4dee-98f8-b888da45372b tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:02.015086 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c3e76eeb-de96-4dee-98f8-b888da45372b tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:02.015878 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c3e76eeb-de96-4dee-98f8-b888da45372b tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:02.016302 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c3e76eeb-de96-4dee-98f8-b888da45372b tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:02.145326 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c3e76eeb-de96-4dee-98f8-b888da45372b tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:02.157303 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c3e76eeb-de96-4dee-98f8-b888da45372b tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.153197 Sep 24 03:34:02.157941 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 257/524] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:02 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:02.232144 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b4c8ffd3-0dff-40f8-9392-20137cd078aa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:02.232648 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b4c8ffd3-0dff-40f8-9392-20137cd078aa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:02.234426 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1623e76f-ec3f-4539-aa9c-74c7724347c8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:02.235248 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1623e76f-ec3f-4539-aa9c-74c7724347c8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:02.239670 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b4c8ffd3-0dff-40f8-9392-20137cd078aa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:02.240118 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b4c8ffd3-0dff-40f8-9392-20137cd078aa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:02.241182 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b4c8ffd3-0dff-40f8-9392-20137cd078aa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:02.241693 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b4c8ffd3-0dff-40f8-9392-20137cd078aa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:02.248696 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1623e76f-ec3f-4539-aa9c-74c7724347c8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:02.249261 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1623e76f-ec3f-4539-aa9c-74c7724347c8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:02.250386 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1623e76f-ec3f-4539-aa9c-74c7724347c8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:02.250386 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1623e76f-ec3f-4539-aa9c-74c7724347c8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:02.473429 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1623e76f-ec3f-4539-aa9c-74c7724347c8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:02.480936 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1623e76f-ec3f-4539-aa9c-74c7724347c8 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1503 microversion: 2.1 time: 0.250549 Sep 24 03:34:02.481519 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 258/525] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:02 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1503 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:02.487556 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b4c8ffd3-0dff-40f8-9392-20137cd078aa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:02.495213 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-79460800-1586-4299-941f-9edea877f4bb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:02.496579 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-79460800-1586-4299-941f-9edea877f4bb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:02.501934 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b4c8ffd3-0dff-40f8-9392-20137cd078aa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:02.504377 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b4c8ffd3-0dff-40f8-9392-20137cd078aa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:02.505784 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b4c8ffd3-0dff-40f8-9392-20137cd078aa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1736 microversion: 2.20 time: 0.278466 Sep 24 03:34:02.505949 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-79460800-1586-4299-941f-9edea877f4bb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:02.521355 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-79460800-1586-4299-941f-9edea877f4bb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:02.521355 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-79460800-1586-4299-941f-9edea877f4bb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:02.521355 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-79460800-1586-4299-941f-9edea877f4bb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:02.522751 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 268/526] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:02 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1736 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:02.769690 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-79460800-1586-4299-941f-9edea877f4bb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:02.779401 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-79460800-1586-4299-941f-9edea877f4bb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.296062 Sep 24 03:34:02.779401 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 259/527] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:02 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:02.943731 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4f8dff64-7fd9-432b-8b46-ee0118ef6bf7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:02.944700 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4f8dff64-7fd9-432b-8b46-ee0118ef6bf7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:02.950951 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4f8dff64-7fd9-432b-8b46-ee0118ef6bf7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:02.951492 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4f8dff64-7fd9-432b-8b46-ee0118ef6bf7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:02.952335 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4f8dff64-7fd9-432b-8b46-ee0118ef6bf7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:02.952839 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4f8dff64-7fd9-432b-8b46-ee0118ef6bf7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:02.979630 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4f8dff64-7fd9-432b-8b46-ee0118ef6bf7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Going to try to terminate instance {{(pid=109374) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:34:03.101174 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4f8dff64-7fd9-432b-8b46-ee0118ef6bf7 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 204 len: 0 microversion: 2.1 time: 0.160704 Sep 24 03:34:03.111230 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-71bb4ec7-99cc-4825-96d7-2e2524b20512 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:03.112036 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-71bb4ec7-99cc-4825-96d7-2e2524b20512 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:03.115020 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 269/528] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:34:02 2021] DELETE /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:34:03.118632 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-71bb4ec7-99cc-4825-96d7-2e2524b20512 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:03.119204 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-71bb4ec7-99cc-4825-96d7-2e2524b20512 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:03.120166 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-71bb4ec7-99cc-4825-96d7-2e2524b20512 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:03.121116 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-71bb4ec7-99cc-4825-96d7-2e2524b20512 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:03.176056 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-148af414-c659-4d65-a951-6a350bee02f9 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:03.176768 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-148af414-c659-4d65-a951-6a350bee02f9 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:03.188875 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-148af414-c659-4d65-a951-6a350bee02f9 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:03.188875 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-148af414-c659-4d65-a951-6a350bee02f9 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:03.188875 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-148af414-c659-4d65-a951-6a350bee02f9 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:03.189407 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-148af414-c659-4d65-a951-6a350bee02f9 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:03.409730 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-71bb4ec7-99cc-4825-96d7-2e2524b20512 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:03.411558 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-148af414-c659-4d65-a951-6a350bee02f9 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:03.419242 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-71bb4ec7-99cc-4825-96d7-2e2524b20512 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1513 microversion: 2.1 time: 0.312522 Sep 24 03:34:03.420621 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-148af414-c659-4d65-a951-6a350bee02f9 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.249746 Sep 24 03:34:03.421049 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 260/529] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:03 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:03.427072 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-92ba2f7e-0073-4b65-9156-83f4127ae4f4 req-31310971-f0b7-47b0-9bfa-24a5510b9896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ef1d15-e520-4dff-8106-a8264da94054", "name": "network-vif-deleted", "tag": "dbe23751-535d-46cb-96da-0ad01cf14019"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:03.429001 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:03.429001 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:34:03.433678 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 270/530] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:03 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:03.436964 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-92ba2f7e-0073-4b65-9156-83f4127ae4f4 req-31310971-f0b7-47b0-9bfa-24a5510b9896 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:03.437406 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-92ba2f7e-0073-4b65-9156-83f4127ae4f4 req-31310971-f0b7-47b0-9bfa-24a5510b9896 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:03.449668 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-92ba2f7e-0073-4b65-9156-83f4127ae4f4 req-31310971-f0b7-47b0-9bfa-24a5510b9896 service nova] Creating event network-vif-deleted:dbe23751-535d-46cb-96da-0ad01cf14019 for instance 97ef1d15-e520-4dff-8106-a8264da94054 on hv-cinder-81080 Sep 24 03:34:03.455056 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-92ba2f7e-0073-4b65-9156-83f4127ae4f4 req-31310971-f0b7-47b0-9bfa-24a5510b9896 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032273 Sep 24 03:34:03.455655 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 261/531] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:34:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:03.499109 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7451793f-22e3-4e0f-8f95-bc0415d1ed39 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:03.499941 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-7451793f-22e3-4e0f-8f95-bc0415d1ed39 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:03.506722 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7451793f-22e3-4e0f-8f95-bc0415d1ed39 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:03.507255 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7451793f-22e3-4e0f-8f95-bc0415d1ed39 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:03.508663 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7451793f-22e3-4e0f-8f95-bc0415d1ed39 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:03.509597 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7451793f-22e3-4e0f-8f95-bc0415d1ed39 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:03.534183 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-46043f8b-73ac-41cf-a2af-dd09b61b937f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:03.535438 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-46043f8b-73ac-41cf-a2af-dd09b61b937f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:03.541843 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-46043f8b-73ac-41cf-a2af-dd09b61b937f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:03.542373 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-46043f8b-73ac-41cf-a2af-dd09b61b937f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:03.545747 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7451793f-22e3-4e0f-8f95-bc0415d1ed39 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:03.546094 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-46043f8b-73ac-41cf-a2af-dd09b61b937f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:03.546226 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7451793f-22e3-4e0f-8f95-bc0415d1ed39 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:03.546668 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.objects.instance [None req-7451793f-22e3-4e0f-8f95-bc0415d1ed39 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lazy-loading 'fault' on Instance uuid 97ef1d15-e520-4dff-8106-a8264da94054 {{(pid=109374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:34:03.546788 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-46043f8b-73ac-41cf-a2af-dd09b61b937f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:03.590090 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7451793f-22e3-4e0f-8f95-bc0415d1ed39 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d6babd47248b59250fe40d9955b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23b942bef2c49778eda908a1dfb6c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:03.597842 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7451793f-22e3-4e0f-8f95-bc0415d1ed39 tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 200 len: 1303 microversion: 2.1 time: 0.102541 Sep 24 03:34:03.608786 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 271/532] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:03 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:03.717775 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-46043f8b-73ac-41cf-a2af-dd09b61b937f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:03.726345 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-46043f8b-73ac-41cf-a2af-dd09b61b937f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:03.728153 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-46043f8b-73ac-41cf-a2af-dd09b61b937f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:03.729097 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-46043f8b-73ac-41cf-a2af-dd09b61b937f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1736 microversion: 2.20 time: 0.201512 Sep 24 03:34:03.729766 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 262/533] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:03 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:34:03.796268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-af922324-2b26-4f90-98f7-cebeeb4f4f1b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:03.797019 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-af922324-2b26-4f90-98f7-cebeeb4f4f1b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:03.803940 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-af922324-2b26-4f90-98f7-cebeeb4f4f1b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:03.804412 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-af922324-2b26-4f90-98f7-cebeeb4f4f1b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:03.805179 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-af922324-2b26-4f90-98f7-cebeeb4f4f1b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:03.806208 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-af922324-2b26-4f90-98f7-cebeeb4f4f1b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:03.966236 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-af922324-2b26-4f90-98f7-cebeeb4f4f1b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:03.979493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-af922324-2b26-4f90-98f7-cebeeb4f4f1b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.186944 Sep 24 03:34:03.982033 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 272/534] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:03 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:04.439927 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-de297e19-e89f-4030-b43b-a289d052e3fe tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:04.440654 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-de297e19-e89f-4030-b43b-a289d052e3fe tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:04.442173 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e045f540-49a6-4cac-bd64-159b62fed182 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:04.442909 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e045f540-49a6-4cac-bd64-159b62fed182 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:04.447105 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-de297e19-e89f-4030-b43b-a289d052e3fe tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:04.447558 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-de297e19-e89f-4030-b43b-a289d052e3fe tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:04.448336 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-de297e19-e89f-4030-b43b-a289d052e3fe tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:04.448767 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-de297e19-e89f-4030-b43b-a289d052e3fe tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:04.449462 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e045f540-49a6-4cac-bd64-159b62fed182 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:04.449954 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e045f540-49a6-4cac-bd64-159b62fed182 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:04.450737 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e045f540-49a6-4cac-bd64-159b62fed182 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:04.451176 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e045f540-49a6-4cac-bd64-159b62fed182 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:04.690700 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-de297e19-e89f-4030-b43b-a289d052e3fe tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:04.693371 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e045f540-49a6-4cac-bd64-159b62fed182 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:04.701597 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e045f540-49a6-4cac-bd64-159b62fed182 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1513 microversion: 2.1 time: 0.266600 Sep 24 03:34:04.711850 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 263/535] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:04 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1513 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:04.712035 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-de297e19-e89f-4030-b43b-a289d052e3fe tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.266210 Sep 24 03:34:04.712035 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 273/536] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:04 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:04.712290 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9b08d449-c1fe-4316-8812-003131eca59f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:04.712290 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9b08d449-c1fe-4316-8812-003131eca59f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] [instance: 97ef1d15-e520-4dff-8106-a8264da94054] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:04.712826 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9b08d449-c1fe-4316-8812-003131eca59f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:04.713397 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9b08d449-c1fe-4316-8812-003131eca59f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:04.714252 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9b08d449-c1fe-4316-8812-003131eca59f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:04.714676 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9b08d449-c1fe-4316-8812-003131eca59f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:04.719435 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-6d708b88-2348-4570-a3cf-34f878bcd2f0 req-393ab6ed-1e5b-4631-a819-cce3ae9e0894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f970df3c-ce7a-4c9c-9564-0a3707e53696", "name": "network-vif-plugged", "status": "completed", "tag": "e6ac50dd-759d-45ec-baea-edee8c9c243d"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:04.720961 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:04.720961 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:34:04.729766 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-9b08d449-c1fe-4316-8812-003131eca59f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] HTTP exception thrown: Instance 97ef1d15-e520-4dff-8106-a8264da94054 could not be found. Sep 24 03:34:04.729983 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-6d708b88-2348-4570-a3cf-34f878bcd2f0 req-393ab6ed-1e5b-4631-a819-cce3ae9e0894 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:04.729983 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-6d708b88-2348-4570-a3cf-34f878bcd2f0 req-393ab6ed-1e5b-4631-a819-cce3ae9e0894 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:04.730157 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9b08d449-c1fe-4316-8812-003131eca59f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] Returning 404 to user: Instance 97ef1d15-e520-4dff-8106-a8264da94054 could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:34:04.730408 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9b08d449-c1fe-4316-8812-003131eca59f tempest-VolumesActionsTest-1610179514 tempest-VolumesActionsTest-1610179514-project] 10.222.0.18 "GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054" status: 404 len: 111 microversion: 2.1 time: 0.027293 Sep 24 03:34:04.731445 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 264/537] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:04 2021] GET /compute/v2.1/servers/97ef1d15-e520-4dff-8106-a8264da94054 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:34:04.747912 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6aa33628-9433-464f-9098-924f3f267cf9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:04.749009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6aa33628-9433-464f-9098-924f3f267cf9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:04.758632 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6aa33628-9433-464f-9098-924f3f267cf9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:04.759071 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6aa33628-9433-464f-9098-924f3f267cf9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:04.759837 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6aa33628-9433-464f-9098-924f3f267cf9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:04.760468 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6aa33628-9433-464f-9098-924f3f267cf9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:04.790939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-6d708b88-2348-4570-a3cf-34f878bcd2f0 req-393ab6ed-1e5b-4631-a819-cce3ae9e0894 service nova] Creating event network-vif-plugged:e6ac50dd-759d-45ec-baea-edee8c9c243d for instance f970df3c-ce7a-4c9c-9564-0a3707e53696 on hv-cinder-81080 Sep 24 03:34:04.797929 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-6d708b88-2348-4570-a3cf-34f878bcd2f0 req-393ab6ed-1e5b-4631-a819-cce3ae9e0894 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093523 Sep 24 03:34:04.801430 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 274/538] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:34:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:05.012013 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-08e8db18-d146-4591-ad3d-0779c68e4ba6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:05.013023 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-08e8db18-d146-4591-ad3d-0779c68e4ba6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:05.026940 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-08e8db18-d146-4591-ad3d-0779c68e4ba6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:05.031594 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-08e8db18-d146-4591-ad3d-0779c68e4ba6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:05.032773 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-08e8db18-d146-4591-ad3d-0779c68e4ba6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:05.035574 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-08e8db18-d146-4591-ad3d-0779c68e4ba6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:05.092386 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6aa33628-9433-464f-9098-924f3f267cf9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:05.108215 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6aa33628-9433-464f-9098-924f3f267cf9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:05.109910 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6aa33628-9433-464f-9098-924f3f267cf9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:05.111910 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6aa33628-9433-464f-9098-924f3f267cf9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1736 microversion: 2.20 time: 0.367603 Sep 24 03:34:05.112600 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 265/539] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:04 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1736 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:05.308128 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-08e8db18-d146-4591-ad3d-0779c68e4ba6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:05.318979 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-08e8db18-d146-4591-ad3d-0779c68e4ba6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.323153 Sep 24 03:34:05.320129 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 275/540] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:04 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:05.723242 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e72c7efc-d87e-42b8-bd1f-e1a0fc34d30d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:05.724568 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e72c7efc-d87e-42b8-bd1f-e1a0fc34d30d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:05.728846 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2bf8561b-2abb-4ccf-940e-0131f178fe90 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:05.729531 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2bf8561b-2abb-4ccf-940e-0131f178fe90 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:05.732021 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e72c7efc-d87e-42b8-bd1f-e1a0fc34d30d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:05.732735 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e72c7efc-d87e-42b8-bd1f-e1a0fc34d30d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:05.737701 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2bf8561b-2abb-4ccf-940e-0131f178fe90 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:05.738413 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2bf8561b-2abb-4ccf-940e-0131f178fe90 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:05.739868 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2bf8561b-2abb-4ccf-940e-0131f178fe90 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:05.741155 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e72c7efc-d87e-42b8-bd1f-e1a0fc34d30d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:05.742543 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2bf8561b-2abb-4ccf-940e-0131f178fe90 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:05.744260 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e72c7efc-d87e-42b8-bd1f-e1a0fc34d30d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:06.054305 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2bf8561b-2abb-4ccf-940e-0131f178fe90 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:06.060194 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e72c7efc-d87e-42b8-bd1f-e1a0fc34d30d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:06.073147 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e72c7efc-d87e-42b8-bd1f-e1a0fc34d30d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1513 microversion: 2.1 time: 0.357807 Sep 24 03:34:06.074896 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2bf8561b-2abb-4ccf-940e-0131f178fe90 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.351205 Sep 24 03:34:06.087078 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 276/541] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:05 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:06.088229 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 266/542] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:05 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1513 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:06.130791 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-828043a0-4c36-4d39-9122-de9da3aebeb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:06.131693 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-828043a0-4c36-4d39-9122-de9da3aebeb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:06.139813 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-828043a0-4c36-4d39-9122-de9da3aebeb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:06.140501 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-828043a0-4c36-4d39-9122-de9da3aebeb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:06.141281 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-828043a0-4c36-4d39-9122-de9da3aebeb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:06.142452 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-828043a0-4c36-4d39-9122-de9da3aebeb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:06.337692 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-889f4db9-7f0d-430b-924f-ec94422ffc3f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:06.338876 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-889f4db9-7f0d-430b-924f-ec94422ffc3f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:06.349456 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-828043a0-4c36-4d39-9122-de9da3aebeb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:06.351635 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-889f4db9-7f0d-430b-924f-ec94422ffc3f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:06.352767 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-889f4db9-7f0d-430b-924f-ec94422ffc3f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:06.353966 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-889f4db9-7f0d-430b-924f-ec94422ffc3f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:06.354727 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-889f4db9-7f0d-430b-924f-ec94422ffc3f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:06.357846 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-828043a0-4c36-4d39-9122-de9da3aebeb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:06.363065 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-828043a0-4c36-4d39-9122-de9da3aebeb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:06.363065 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-828043a0-4c36-4d39-9122-de9da3aebeb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1736 microversion: 2.20 time: 0.233453 Sep 24 03:34:06.363065 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 277/543] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:06 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1736 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:06.492353 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-cb2b4f01-7b31-4e4b-93c7-d62e14b8843d req-da8c2186-6eb9-4d8a-a51c-2ee6ef07ca45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc", "name": "network-vif-deleted", "tag": "8a7ce87c-b9c1-4dd8-afc3-2ac8f3a08d7e"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:06.493948 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:06.493948 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:34:06.503589 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-cb2b4f01-7b31-4e4b-93c7-d62e14b8843d req-da8c2186-6eb9-4d8a-a51c-2ee6ef07ca45 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:06.503589 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-cb2b4f01-7b31-4e4b-93c7-d62e14b8843d req-da8c2186-6eb9-4d8a-a51c-2ee6ef07ca45 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:06.515026 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-cb2b4f01-7b31-4e4b-93c7-d62e14b8843d req-da8c2186-6eb9-4d8a-a51c-2ee6ef07ca45 service nova] Creating event network-vif-deleted:8a7ce87c-b9c1-4dd8-afc3-2ac8f3a08d7e for instance e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc on hv-cinder-81080 Sep 24 03:34:06.520757 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-cb2b4f01-7b31-4e4b-93c7-d62e14b8843d req-da8c2186-6eb9-4d8a-a51c-2ee6ef07ca45 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032235 Sep 24 03:34:06.521540 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 278/544] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:34:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:34:06.569436 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-889f4db9-7f0d-430b-924f-ec94422ffc3f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:06.578055 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-889f4db9-7f0d-430b-924f-ec94422ffc3f tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.244775 Sep 24 03:34:06.581749 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 267/545] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:06 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:07.096296 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-69f98883-5c9b-4fee-a388-6caed046e1a7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:07.097934 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-69f98883-5c9b-4fee-a388-6caed046e1a7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:07.105925 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-164f78fe-4e85-4d9f-8b83-406ca277cbed tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:07.107384 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-164f78fe-4e85-4d9f-8b83-406ca277cbed tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:07.116616 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-69f98883-5c9b-4fee-a388-6caed046e1a7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:07.117225 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-69f98883-5c9b-4fee-a388-6caed046e1a7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:07.121169 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-164f78fe-4e85-4d9f-8b83-406ca277cbed tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:07.121611 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-164f78fe-4e85-4d9f-8b83-406ca277cbed tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:07.122414 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-164f78fe-4e85-4d9f-8b83-406ca277cbed tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:07.122899 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-164f78fe-4e85-4d9f-8b83-406ca277cbed tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:07.128912 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-69f98883-5c9b-4fee-a388-6caed046e1a7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:07.129449 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-69f98883-5c9b-4fee-a388-6caed046e1a7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:07.252291 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-164f78fe-4e85-4d9f-8b83-406ca277cbed tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:07.265424 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-164f78fe-4e85-4d9f-8b83-406ca277cbed tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1471 microversion: 2.1 time: 0.164743 Sep 24 03:34:07.277352 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 268/546] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:07 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:07.337112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-69f98883-5c9b-4fee-a388-6caed046e1a7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:07.351239 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-69f98883-5c9b-4fee-a388-6caed046e1a7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.260968 Sep 24 03:34:07.352074 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 279/547] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:07 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:07.383966 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ea0ff017-03b4-4ed5-91f1-eb386991344e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:07.385111 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ea0ff017-03b4-4ed5-91f1-eb386991344e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:07.393503 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ea0ff017-03b4-4ed5-91f1-eb386991344e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:07.394136 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ea0ff017-03b4-4ed5-91f1-eb386991344e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:07.395074 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ea0ff017-03b4-4ed5-91f1-eb386991344e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:07.395577 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ea0ff017-03b4-4ed5-91f1-eb386991344e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:07.572024 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ea0ff017-03b4-4ed5-91f1-eb386991344e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:07.586580 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ea0ff017-03b4-4ed5-91f1-eb386991344e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:07.588095 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ea0ff017-03b4-4ed5-91f1-eb386991344e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:07.589296 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ea0ff017-03b4-4ed5-91f1-eb386991344e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1736 microversion: 2.20 time: 0.209624 Sep 24 03:34:07.598062 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-02e981f1-b081-4bd6-817c-38d4693b8d94 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:07.599079 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-02e981f1-b081-4bd6-817c-38d4693b8d94 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:07.605449 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 269/548] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:07 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:07.614254 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02e981f1-b081-4bd6-817c-38d4693b8d94 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:07.615219 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02e981f1-b081-4bd6-817c-38d4693b8d94 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:07.617756 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02e981f1-b081-4bd6-817c-38d4693b8d94 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:07.617756 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02e981f1-b081-4bd6-817c-38d4693b8d94 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:07.773536 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-02e981f1-b081-4bd6-817c-38d4693b8d94 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:07.781757 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-02e981f1-b081-4bd6-817c-38d4693b8d94 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.187638 Sep 24 03:34:07.782588 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 280/549] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:07 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:08.284914 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ba34db2c-8a4b-482a-8d32-763e66de813d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:08.286469 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ba34db2c-8a4b-482a-8d32-763e66de813d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:08.292822 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ba34db2c-8a4b-482a-8d32-763e66de813d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:08.293506 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ba34db2c-8a4b-482a-8d32-763e66de813d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:08.294478 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ba34db2c-8a4b-482a-8d32-763e66de813d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:08.295064 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ba34db2c-8a4b-482a-8d32-763e66de813d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:08.364488 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ba34db2c-8a4b-482a-8d32-763e66de813d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:08.370226 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a00fe0ac-a465-4d97-9531-6386688e4c51 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:08.370839 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a00fe0ac-a465-4d97-9531-6386688e4c51 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:08.374134 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ba34db2c-8a4b-482a-8d32-763e66de813d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1471 microversion: 2.1 time: 0.093653 Sep 24 03:34:08.375030 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 270/550] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:08 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1471 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:08.378695 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a00fe0ac-a465-4d97-9531-6386688e4c51 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:08.379367 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a00fe0ac-a465-4d97-9531-6386688e4c51 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:08.380151 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a00fe0ac-a465-4d97-9531-6386688e4c51 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:08.380579 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a00fe0ac-a465-4d97-9531-6386688e4c51 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:08.512579 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a00fe0ac-a465-4d97-9531-6386688e4c51 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:08.522396 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a00fe0ac-a465-4d97-9531-6386688e4c51 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.156440 Sep 24 03:34:08.522986 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 281/551] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:08 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:08.609222 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-fc6e9bb1-d743-4b56-824c-264464a01333 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:08.609855 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-fc6e9bb1-d743-4b56-824c-264464a01333 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:08.617372 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fc6e9bb1-d743-4b56-824c-264464a01333 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:08.618196 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fc6e9bb1-d743-4b56-824c-264464a01333 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:08.619287 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fc6e9bb1-d743-4b56-824c-264464a01333 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:08.619710 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fc6e9bb1-d743-4b56-824c-264464a01333 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:08.757290 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-fc6e9bb1-d743-4b56-824c-264464a01333 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:08.765468 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-fc6e9bb1-d743-4b56-824c-264464a01333 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:08.767612 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-fc6e9bb1-d743-4b56-824c-264464a01333 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:08.770276 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-fc6e9bb1-d743-4b56-824c-264464a01333 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1736 microversion: 2.20 time: 0.164279 Sep 24 03:34:08.770276 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 271/552] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:08 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:08.800310 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3603d088-9746-4d15-b67c-8737b68c24bc tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:08.801055 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3603d088-9746-4d15-b67c-8737b68c24bc tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:08.807027 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3603d088-9746-4d15-b67c-8737b68c24bc tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:08.807588 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3603d088-9746-4d15-b67c-8737b68c24bc tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:08.808413 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3603d088-9746-4d15-b67c-8737b68c24bc tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:08.808911 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3603d088-9746-4d15-b67c-8737b68c24bc tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:08.987448 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3603d088-9746-4d15-b67c-8737b68c24bc tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:09.007847 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3603d088-9746-4d15-b67c-8737b68c24bc tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.211589 Sep 24 03:34:09.017994 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 282/553] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:08 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:09.393398 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-339220ab-5919-487a-9a81-5d4ee5af2375 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:09.394806 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-339220ab-5919-487a-9a81-5d4ee5af2375 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:09.401424 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-339220ab-5919-487a-9a81-5d4ee5af2375 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:09.401998 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-339220ab-5919-487a-9a81-5d4ee5af2375 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:09.402805 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-339220ab-5919-487a-9a81-5d4ee5af2375 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:09.403421 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-339220ab-5919-487a-9a81-5d4ee5af2375 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:09.437408 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-339220ab-5919-487a-9a81-5d4ee5af2375 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:09.437916 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-339220ab-5919-487a-9a81-5d4ee5af2375 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:09.439019 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-339220ab-5919-487a-9a81-5d4ee5af2375 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lazy-loading 'fault' on Instance uuid e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:34:09.504362 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-339220ab-5919-487a-9a81-5d4ee5af2375 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:09.513341 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-339220ab-5919-487a-9a81-5d4ee5af2375 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 200 len: 1307 microversion: 2.1 time: 0.124764 Sep 24 03:34:09.517800 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 272/554] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:09 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 1307 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:09.542504 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-eb1f9904-e073-438e-8ed7-c8fe8a90549c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:09.543211 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-eb1f9904-e073-438e-8ed7-c8fe8a90549c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:09.552656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-eb1f9904-e073-438e-8ed7-c8fe8a90549c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:09.553105 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-eb1f9904-e073-438e-8ed7-c8fe8a90549c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:09.553919 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-eb1f9904-e073-438e-8ed7-c8fe8a90549c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:09.554352 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-eb1f9904-e073-438e-8ed7-c8fe8a90549c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:09.722797 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-eb1f9904-e073-438e-8ed7-c8fe8a90549c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:09.731817 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-eb1f9904-e073-438e-8ed7-c8fe8a90549c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1359 microversion: 2.1 time: 0.195372 Sep 24 03:34:09.734655 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 283/555] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:09 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:09.790970 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b447bd35-4ccd-4a99-bd5c-a9f41cc7f5a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:09.791707 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b447bd35-4ccd-4a99-bd5c-a9f41cc7f5a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:09.800334 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b447bd35-4ccd-4a99-bd5c-a9f41cc7f5a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:09.800869 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b447bd35-4ccd-4a99-bd5c-a9f41cc7f5a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:09.801751 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b447bd35-4ccd-4a99-bd5c-a9f41cc7f5a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:09.802268 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b447bd35-4ccd-4a99-bd5c-a9f41cc7f5a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:09.957954 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b447bd35-4ccd-4a99-bd5c-a9f41cc7f5a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:09.966141 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b447bd35-4ccd-4a99-bd5c-a9f41cc7f5a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:09.967757 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b447bd35-4ccd-4a99-bd5c-a9f41cc7f5a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:09.968987 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b447bd35-4ccd-4a99-bd5c-a9f41cc7f5a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1736 microversion: 2.20 time: 0.181741 Sep 24 03:34:09.969792 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 273/556] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:09 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:10.029927 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1e6dfbe1-c9b7-4e47-aa2e-9836365b830b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:10.031116 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1e6dfbe1-c9b7-4e47-aa2e-9836365b830b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:10.037977 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1e6dfbe1-c9b7-4e47-aa2e-9836365b830b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:10.038420 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1e6dfbe1-c9b7-4e47-aa2e-9836365b830b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:10.039279 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1e6dfbe1-c9b7-4e47-aa2e-9836365b830b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:10.039764 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1e6dfbe1-c9b7-4e47-aa2e-9836365b830b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:10.183233 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1e6dfbe1-c9b7-4e47-aa2e-9836365b830b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:10.189913 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1e6dfbe1-c9b7-4e47-aa2e-9836365b830b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.163635 Sep 24 03:34:10.193750 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 284/557] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:10 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:10.532973 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-236948b0-bc7a-45a5-8268-a56a729ecad2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:10.534027 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-236948b0-bc7a-45a5-8268-a56a729ecad2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:10.542941 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-236948b0-bc7a-45a5-8268-a56a729ecad2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:10.543525 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-236948b0-bc7a-45a5-8268-a56a729ecad2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:10.544565 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-236948b0-bc7a-45a5-8268-a56a729ecad2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:10.545104 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-236948b0-bc7a-45a5-8268-a56a729ecad2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:10.567158 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-236948b0-bc7a-45a5-8268-a56a729ecad2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] HTTP exception thrown: Instance e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc could not be found. Sep 24 03:34:10.567960 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-236948b0-bc7a-45a5-8268-a56a729ecad2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Returning 404 to user: Instance e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:34:10.569091 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-236948b0-bc7a-45a5-8268-a56a729ecad2 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc" status: 404 len: 111 microversion: 2.1 time: 0.041349 Sep 24 03:34:10.569838 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 274/558] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:10 2021] GET /compute/v2.1/servers/e071fd3f-4b5a-4d8a-95bd-22df1da3e0dc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:34:10.751672 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e81530f6-4f2f-48c8-99f7-be03f444592f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:10.753673 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e81530f6-4f2f-48c8-99f7-be03f444592f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:10.768305 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e81530f6-4f2f-48c8-99f7-be03f444592f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:10.769399 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e81530f6-4f2f-48c8-99f7-be03f444592f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:10.773945 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e81530f6-4f2f-48c8-99f7-be03f444592f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:10.777868 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e81530f6-4f2f-48c8-99f7-be03f444592f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:10.989131 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-bdebf2ef-565e-41ee-9dab-5691fde11264 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:10.990610 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-bdebf2ef-565e-41ee-9dab-5691fde11264 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:11.017141 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bdebf2ef-565e-41ee-9dab-5691fde11264 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:11.020810 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bdebf2ef-565e-41ee-9dab-5691fde11264 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:11.026233 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bdebf2ef-565e-41ee-9dab-5691fde11264 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:11.027008 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bdebf2ef-565e-41ee-9dab-5691fde11264 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:11.069957 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e81530f6-4f2f-48c8-99f7-be03f444592f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:11.087430 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e81530f6-4f2f-48c8-99f7-be03f444592f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1550 microversion: 2.1 time: 0.341010 Sep 24 03:34:11.122159 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 285/559] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:10 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1550 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:11.147211 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-14e84c57-3587-4ff4-b865-280aa49604f1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:11.172820 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-14e84c57-3587-4ff4-b865-280aa49604f1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:11.202744 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-14e84c57-3587-4ff4-b865-280aa49604f1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:11.203847 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-14e84c57-3587-4ff4-b865-280aa49604f1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:11.233193 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-14e84c57-3587-4ff4-b865-280aa49604f1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:11.238030 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-14e84c57-3587-4ff4-b865-280aa49604f1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:11.446430 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-bdebf2ef-565e-41ee-9dab-5691fde11264 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:11.458167 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-bdebf2ef-565e-41ee-9dab-5691fde11264 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:11.459999 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-bdebf2ef-565e-41ee-9dab-5691fde11264 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:11.465823 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-bdebf2ef-565e-41ee-9dab-5691fde11264 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1736 microversion: 2.20 time: 0.482228 Sep 24 03:34:11.477176 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 275/560] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:10 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1736 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:11.496911 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-0715d28c-d054-4e61-8959-26a0e7611658 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:11.497612 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-0715d28c-d054-4e61-8959-26a0e7611658 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:11.515571 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0715d28c-d054-4e61-8959-26a0e7611658 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:11.516113 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0715d28c-d054-4e61-8959-26a0e7611658 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:11.517362 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0715d28c-d054-4e61-8959-26a0e7611658 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:11.518112 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0715d28c-d054-4e61-8959-26a0e7611658 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:11.575101 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-14e84c57-3587-4ff4-b865-280aa49604f1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:11.591098 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-14e84c57-3587-4ff4-b865-280aa49604f1 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1550 microversion: 2.1 time: 0.459348 Sep 24 03:34:11.592096 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 286/561] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:11 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1550 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:11.610046 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c296f628-7a67-46e1-96e5-1cf1dfb33903 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:11.616820 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:11.616820 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:34:11.618172 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c296f628-7a67-46e1-96e5-1cf1dfb33903 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:11.619009 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c296f628-7a67-46e1-96e5-1cf1dfb33903 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Searching by: {'deleted': False, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f'} {{(pid=109374) get_all /opt/stack/nova/nova/compute/api.py:2905}} Sep 24 03:34:11.627025 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c296f628-7a67-46e1-96e5-1cf1dfb33903 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:11.627565 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c296f628-7a67-46e1-96e5-1cf1dfb33903 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:11.628435 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c296f628-7a67-46e1-96e5-1cf1dfb33903 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:11.628915 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c296f628-7a67-46e1-96e5-1cf1dfb33903 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:11.808009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-0715d28c-d054-4e61-8959-26a0e7611658 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:11.817491 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-0715d28c-d054-4e61-8959-26a0e7611658 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.340916 Sep 24 03:34:11.822165 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 276/562] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:11 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:11.826815 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-12ec8bd9-7566-4086-94c6-2184ed675c82 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:11.832335 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-12ec8bd9-7566-4086-94c6-2184ed675c82 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:11.852848 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-12ec8bd9-7566-4086-94c6-2184ed675c82 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:11.853540 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-12ec8bd9-7566-4086-94c6-2184ed675c82 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:11.854687 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-12ec8bd9-7566-4086-94c6-2184ed675c82 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:11.861576 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.multi_cell_list [None req-c296f628-7a67-46e1-96e5-1cf1dfb33903 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=109374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Sep 24 03:34:11.863185 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-12ec8bd9-7566-4086-94c6-2184ed675c82 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:11.921224 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-12ec8bd9-7566-4086-94c6-2184ed675c82 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Going to try to terminate instance {{(pid=109375) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:34:12.014472 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c296f628-7a67-46e1-96e5-1cf1dfb33903 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.407465 Sep 24 03:34:12.015736 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 287/563] 10.222.0.18 () {58 vars in 1125 bytes} [Fri Sep 24 03:34:11 2021] GET /compute/v2.1/servers => generated 343 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:12.029686 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a18f41d5-b597-4fb2-9d1f-7ec84e4c1afb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:12.030774 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a18f41d5-b597-4fb2-9d1f-7ec84e4c1afb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:12.044965 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a18f41d5-b597-4fb2-9d1f-7ec84e4c1afb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:12.047897 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a18f41d5-b597-4fb2-9d1f-7ec84e4c1afb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:12.049606 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a18f41d5-b597-4fb2-9d1f-7ec84e4c1afb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:12.050316 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a18f41d5-b597-4fb2-9d1f-7ec84e4c1afb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:12.085896 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-12ec8bd9-7566-4086-94c6-2184ed675c82 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 204 len: 0 microversion: 2.1 time: 0.260054 Sep 24 03:34:12.086514 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 277/564] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:34:11 2021] DELETE /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:34:12.104323 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a9089d73-c7d9-4d2a-bfa5-0814992b74c8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:12.106549 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a9089d73-c7d9-4d2a-bfa5-0814992b74c8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:12.117427 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a9089d73-c7d9-4d2a-bfa5-0814992b74c8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:12.117913 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a9089d73-c7d9-4d2a-bfa5-0814992b74c8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:12.119218 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a9089d73-c7d9-4d2a-bfa5-0814992b74c8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:12.120009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a9089d73-c7d9-4d2a-bfa5-0814992b74c8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:12.330804 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a18f41d5-b597-4fb2-9d1f-7ec84e4c1afb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:12.352346 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a9089d73-c7d9-4d2a-bfa5-0814992b74c8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:12.354666 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a18f41d5-b597-4fb2-9d1f-7ec84e4c1afb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1550 microversion: 2.1 time: 0.324373 Sep 24 03:34:12.357127 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 288/565] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:12 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1550 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:12.372640 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a9089d73-c7d9-4d2a-bfa5-0814992b74c8 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1512 microversion: 2.1 time: 0.280813 Sep 24 03:34:12.373746 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 278/566] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:12 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1512 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:12.489349 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-09f64a9f-25e8-47e9-8c9e-70fc6a9a8980 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:12.489539 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-09f64a9f-25e8-47e9-8c9e-70fc6a9a8980 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:12.497208 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-09f64a9f-25e8-47e9-8c9e-70fc6a9a8980 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:12.497995 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-09f64a9f-25e8-47e9-8c9e-70fc6a9a8980 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:12.498740 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-09f64a9f-25e8-47e9-8c9e-70fc6a9a8980 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:12.499277 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-09f64a9f-25e8-47e9-8c9e-70fc6a9a8980 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:12.747877 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-09f64a9f-25e8-47e9-8c9e-70fc6a9a8980 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:12.767374 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-09f64a9f-25e8-47e9-8c9e-70fc6a9a8980 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:12.767374 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-09f64a9f-25e8-47e9-8c9e-70fc6a9a8980 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:12.767374 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-09f64a9f-25e8-47e9-8c9e-70fc6a9a8980 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1736 microversion: 2.20 time: 0.280871 Sep 24 03:34:12.767776 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 289/567] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:12 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1736 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:12.842649 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a168fa6c-2a53-4b14-b38d-9d59ddacc932 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:12.843788 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a168fa6c-2a53-4b14-b38d-9d59ddacc932 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:12.856017 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a168fa6c-2a53-4b14-b38d-9d59ddacc932 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:12.856471 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a168fa6c-2a53-4b14-b38d-9d59ddacc932 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:12.857260 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a168fa6c-2a53-4b14-b38d-9d59ddacc932 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:12.857691 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a168fa6c-2a53-4b14-b38d-9d59ddacc932 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:13.192533 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a168fa6c-2a53-4b14-b38d-9d59ddacc932 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:13.201188 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a168fa6c-2a53-4b14-b38d-9d59ddacc932 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.363780 Sep 24 03:34:13.209001 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 279/568] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:12 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:13.394450 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ff14506d-0de4-4092-b898-a1372f81e323 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:13.396041 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ff14506d-0de4-4092-b898-a1372f81e323 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:13.406038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ff14506d-0de4-4092-b898-a1372f81e323 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:13.406692 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ff14506d-0de4-4092-b898-a1372f81e323 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:13.409195 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ff14506d-0de4-4092-b898-a1372f81e323 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:13.410605 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ff14506d-0de4-4092-b898-a1372f81e323 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:13.631637 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ff14506d-0de4-4092-b898-a1372f81e323 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:13.638433 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ff14506d-0de4-4092-b898-a1372f81e323 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1512 microversion: 2.1 time: 0.249922 Sep 24 03:34:13.649168 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 290/569] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:13 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1512 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:13.790657 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-48296046-642f-43c6-8e02-b1f876e88716 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:13.791575 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-48296046-642f-43c6-8e02-b1f876e88716 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:13.804531 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-48296046-642f-43c6-8e02-b1f876e88716 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:13.805040 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-48296046-642f-43c6-8e02-b1f876e88716 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:13.806381 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-48296046-642f-43c6-8e02-b1f876e88716 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:13.806876 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-48296046-642f-43c6-8e02-b1f876e88716 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:14.023277 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-48296046-642f-43c6-8e02-b1f876e88716 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:14.031758 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-48296046-642f-43c6-8e02-b1f876e88716 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:14.033768 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-48296046-642f-43c6-8e02-b1f876e88716 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:14.034949 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-48296046-642f-43c6-8e02-b1f876e88716 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1718 microversion: 2.20 time: 0.251012 Sep 24 03:34:14.048588 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 280/570] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:13 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1718 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:14.155349 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4edf9065-da5f-4e43-820c-a218048a7863 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2106e2e4-3d95-4402-9720-cf1b0d74085a"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:14.157058 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4edf9065-da5f-4e43-820c-a218048a7863 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:14.166409 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4edf9065-da5f-4e43-820c-a218048a7863 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:14.166858 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4edf9065-da5f-4e43-820c-a218048a7863 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:14.167637 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4edf9065-da5f-4e43-820c-a218048a7863 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:14.168238 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4edf9065-da5f-4e43-820c-a218048a7863 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:14.219165 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-30e20176-eb7c-4957-88ad-ddd6891541b5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:14.219813 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-30e20176-eb7c-4957-88ad-ddd6891541b5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:14.234072 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-30e20176-eb7c-4957-88ad-ddd6891541b5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:14.234845 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-30e20176-eb7c-4957-88ad-ddd6891541b5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:14.236546 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-30e20176-eb7c-4957-88ad-ddd6891541b5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:14.237143 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-30e20176-eb7c-4957-88ad-ddd6891541b5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:14.475717 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-30e20176-eb7c-4957-88ad-ddd6891541b5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:14.483814 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-30e20176-eb7c-4957-88ad-ddd6891541b5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.267926 Sep 24 03:34:14.497250 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 281/571] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:14 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:14.617096 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4edf9065-da5f-4e43-820c-a218048a7863 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "POST /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.465452 Sep 24 03:34:14.619130 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 291/572] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:34:14 2021] POST /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/os-volume_attachments => generated 194 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:14.661611 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-420362ca-25f4-4e12-b40c-3a067b70bc27 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:14.662236 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-420362ca-25f4-4e12-b40c-3a067b70bc27 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:14.672585 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-420362ca-25f4-4e12-b40c-3a067b70bc27 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:14.680581 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-420362ca-25f4-4e12-b40c-3a067b70bc27 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:14.681666 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-420362ca-25f4-4e12-b40c-3a067b70bc27 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:14.681980 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-420362ca-25f4-4e12-b40c-3a067b70bc27 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:14.863194 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-420362ca-25f4-4e12-b40c-3a067b70bc27 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:14.872569 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-420362ca-25f4-4e12-b40c-3a067b70bc27 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 200 len: 1512 microversion: 2.1 time: 0.218119 Sep 24 03:34:14.884603 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 282/573] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:14 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:15.059349 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ba9f1d3f-aefa-42f5-9d84-f8290e9ebe3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:15.060241 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ba9f1d3f-aefa-42f5-9d84-f8290e9ebe3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:15.067642 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ba9f1d3f-aefa-42f5-9d84-f8290e9ebe3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:15.068273 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ba9f1d3f-aefa-42f5-9d84-f8290e9ebe3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:15.069151 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ba9f1d3f-aefa-42f5-9d84-f8290e9ebe3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:15.069684 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ba9f1d3f-aefa-42f5-9d84-f8290e9ebe3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:15.107878 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-144100ee-19a6-4a86-bc80-b47e98153f8d req-a6230f1d-3912-45c3-88ec-fe3bcec3774b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e63e97-71b1-48b6-af18-ea2f33d55dd3", "name": "network-vif-deleted", "tag": "560c4fee-dbda-4b10-966d-3589544f945a"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:15.111212 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:15.111212 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:34:15.133401 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-144100ee-19a6-4a86-bc80-b47e98153f8d req-a6230f1d-3912-45c3-88ec-fe3bcec3774b service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:15.134325 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-144100ee-19a6-4a86-bc80-b47e98153f8d req-a6230f1d-3912-45c3-88ec-fe3bcec3774b service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:15.175651 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-144100ee-19a6-4a86-bc80-b47e98153f8d req-a6230f1d-3912-45c3-88ec-fe3bcec3774b service nova] Creating event network-vif-deleted:560c4fee-dbda-4b10-966d-3589544f945a for instance d7e63e97-71b1-48b6-af18-ea2f33d55dd3 on hv-cinder-81080 Sep 24 03:34:15.183904 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-144100ee-19a6-4a86-bc80-b47e98153f8d req-a6230f1d-3912-45c3-88ec-fe3bcec3774b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086037 Sep 24 03:34:15.184519 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 283/574] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:34:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:34:15.283156 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ba9f1d3f-aefa-42f5-9d84-f8290e9ebe3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:15.291760 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ba9f1d3f-aefa-42f5-9d84-f8290e9ebe3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:15.293287 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ba9f1d3f-aefa-42f5-9d84-f8290e9ebe3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:15.294473 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ba9f1d3f-aefa-42f5-9d84-f8290e9ebe3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1718 microversion: 2.20 time: 0.241879 Sep 24 03:34:15.295807 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 292/575] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:15 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1718 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:15.502019 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-82db4daa-2d30-4b56-9bd8-edbeb8cdcd2a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:15.502959 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-82db4daa-2d30-4b56-9bd8-edbeb8cdcd2a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:15.510650 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-82db4daa-2d30-4b56-9bd8-edbeb8cdcd2a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:15.511034 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-82db4daa-2d30-4b56-9bd8-edbeb8cdcd2a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:15.511869 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-82db4daa-2d30-4b56-9bd8-edbeb8cdcd2a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:15.512359 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-82db4daa-2d30-4b56-9bd8-edbeb8cdcd2a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:15.662031 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-82db4daa-2d30-4b56-9bd8-edbeb8cdcd2a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:15.671692 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-82db4daa-2d30-4b56-9bd8-edbeb8cdcd2a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.174840 Sep 24 03:34:15.673259 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 284/576] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:15 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:15.891818 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d7672f8f-cc96-46a4-9d4b-6b98783dac0b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:15.892768 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d7672f8f-cc96-46a4-9d4b-6b98783dac0b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: d7e63e97-71b1-48b6-af18-ea2f33d55dd3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:15.899797 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d7672f8f-cc96-46a4-9d4b-6b98783dac0b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:15.900583 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d7672f8f-cc96-46a4-9d4b-6b98783dac0b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:15.901613 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d7672f8f-cc96-46a4-9d4b-6b98783dac0b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:15.902431 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d7672f8f-cc96-46a4-9d4b-6b98783dac0b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:15.918741 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-d7672f8f-cc96-46a4-9d4b-6b98783dac0b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] HTTP exception thrown: Instance d7e63e97-71b1-48b6-af18-ea2f33d55dd3 could not be found. Sep 24 03:34:15.919612 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d7672f8f-cc96-46a4-9d4b-6b98783dac0b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Returning 404 to user: Instance d7e63e97-71b1-48b6-af18-ea2f33d55dd3 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:34:15.920685 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d7672f8f-cc96-46a4-9d4b-6b98783dac0b tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3" status: 404 len: 111 microversion: 2.1 time: 0.033315 Sep 24 03:34:15.921815 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 293/577] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:15 2021] GET /compute/v2.1/servers/d7e63e97-71b1-48b6-af18-ea2f33d55dd3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:34:15.931268 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d3cf01cd-76d7-4131-a982-f41940fb9eeb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:15.931890 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d3cf01cd-76d7-4131-a982-f41940fb9eeb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:15.940092 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d3cf01cd-76d7-4131-a982-f41940fb9eeb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:15.940727 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d3cf01cd-76d7-4131-a982-f41940fb9eeb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:15.941846 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d3cf01cd-76d7-4131-a982-f41940fb9eeb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:15.942528 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d3cf01cd-76d7-4131-a982-f41940fb9eeb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:15.972091 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d3cf01cd-76d7-4131-a982-f41940fb9eeb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Going to try to terminate instance {{(pid=109375) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:34:16.071676 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d3cf01cd-76d7-4131-a982-f41940fb9eeb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 204 len: 0 microversion: 2.1 time: 0.144199 Sep 24 03:34:16.072258 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 285/578] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:34:15 2021] DELETE /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:34:16.083120 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-55c253a0-b269-46d6-9a98-1ddc0d3625fd tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:16.084232 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-55c253a0-b269-46d6-9a98-1ddc0d3625fd tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:16.091783 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-55c253a0-b269-46d6-9a98-1ddc0d3625fd tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:16.092690 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-55c253a0-b269-46d6-9a98-1ddc0d3625fd tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:16.093676 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-55c253a0-b269-46d6-9a98-1ddc0d3625fd tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:16.094220 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-55c253a0-b269-46d6-9a98-1ddc0d3625fd tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:16.245374 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-55c253a0-b269-46d6-9a98-1ddc0d3625fd tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:16.253802 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-55c253a0-b269-46d6-9a98-1ddc0d3625fd tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 200 len: 1513 microversion: 2.1 time: 0.176283 Sep 24 03:34:16.254647 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 294/579] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:16 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:16.312899 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-73a392e6-37ee-4faf-b64a-31d00d4040d7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:16.314884 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-73a392e6-37ee-4faf-b64a-31d00d4040d7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:16.322148 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-73a392e6-37ee-4faf-b64a-31d00d4040d7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:16.322887 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-73a392e6-37ee-4faf-b64a-31d00d4040d7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:16.323873 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-73a392e6-37ee-4faf-b64a-31d00d4040d7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:16.324349 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-73a392e6-37ee-4faf-b64a-31d00d4040d7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:16.466185 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-73a392e6-37ee-4faf-b64a-31d00d4040d7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:16.476027 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-73a392e6-37ee-4faf-b64a-31d00d4040d7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:16.477541 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-73a392e6-37ee-4faf-b64a-31d00d4040d7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:16.479047 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-73a392e6-37ee-4faf-b64a-31d00d4040d7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1718 microversion: 2.20 time: 0.170121 Sep 24 03:34:16.479657 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 286/580] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:16 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1718 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:16.702172 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e2710bfd-c04e-4d56-986c-eb558284377e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:16.702702 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e2710bfd-c04e-4d56-986c-eb558284377e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:16.709726 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e2710bfd-c04e-4d56-986c-eb558284377e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:16.710191 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e2710bfd-c04e-4d56-986c-eb558284377e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:16.710976 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e2710bfd-c04e-4d56-986c-eb558284377e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:16.711406 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e2710bfd-c04e-4d56-986c-eb558284377e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:16.871262 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e2710bfd-c04e-4d56-986c-eb558284377e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:16.880442 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e2710bfd-c04e-4d56-986c-eb558284377e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.181740 Sep 24 03:34:16.882064 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 295/581] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:16 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:17.014957 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-a3b6fc6e-54eb-4a40-9c02-93f5d746c75a req-88888969-4dea-4b01-b101-a2836d697a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f043b14-af6f-4d95-a094-87fa6c768493", "name": "network-vif-unplugged", "status": "completed", "tag": "67582d29-a79f-4ee2-8844-18b26e15268b"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:17.018654 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:17.018654 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:34:17.027702 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-a3b6fc6e-54eb-4a40-9c02-93f5d746c75a req-88888969-4dea-4b01-b101-a2836d697a0e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:17.028459 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-a3b6fc6e-54eb-4a40-9c02-93f5d746c75a req-88888969-4dea-4b01-b101-a2836d697a0e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:17.043151 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.compute.server_external_events [req-a3b6fc6e-54eb-4a40-9c02-93f5d746c75a req-88888969-4dea-4b01-b101-a2836d697a0e service nova] Unable to find a host for instance 3f043b14-af6f-4d95-a094-87fa6c768493. Dropping event network-vif-unplugged {{(pid=109375) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 24 03:34:17.044435 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-a3b6fc6e-54eb-4a40-9c02-93f5d746c75a req-88888969-4dea-4b01-b101-a2836d697a0e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033745 Sep 24 03:34:17.045552 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 287/582] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:34:17 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 24 03:34:17.273900 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-354451f0-a69c-4bc5-90a2-88a6a29146ff tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:17.274609 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-354451f0-a69c-4bc5-90a2-88a6a29146ff tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:17.280866 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-354451f0-a69c-4bc5-90a2-88a6a29146ff tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:17.281387 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-354451f0-a69c-4bc5-90a2-88a6a29146ff tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:17.282896 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-354451f0-a69c-4bc5-90a2-88a6a29146ff tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:17.283589 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-354451f0-a69c-4bc5-90a2-88a6a29146ff tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:17.410287 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-354451f0-a69c-4bc5-90a2-88a6a29146ff tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:17.420164 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-354451f0-a69c-4bc5-90a2-88a6a29146ff tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 200 len: 1513 microversion: 2.1 time: 0.150225 Sep 24 03:34:17.420724 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 296/583] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:17 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:17.498319 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1dd79fa2-47df-4744-b029-e448fdb4f66c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:17.499677 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1dd79fa2-47df-4744-b029-e448fdb4f66c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:17.506913 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1dd79fa2-47df-4744-b029-e448fdb4f66c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:17.507292 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1dd79fa2-47df-4744-b029-e448fdb4f66c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:17.508252 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1dd79fa2-47df-4744-b029-e448fdb4f66c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:17.508696 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1dd79fa2-47df-4744-b029-e448fdb4f66c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:17.649209 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1dd79fa2-47df-4744-b029-e448fdb4f66c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:17.659468 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1dd79fa2-47df-4744-b029-e448fdb4f66c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:17.680349 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1dd79fa2-47df-4744-b029-e448fdb4f66c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:17.682467 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1dd79fa2-47df-4744-b029-e448fdb4f66c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1661 microversion: 2.20 time: 0.187760 Sep 24 03:34:17.699120 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 288/584] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:17 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1661 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:17.705450 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2803753d-77ad-4524-8631-d920d295d869 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1523763a-fbce-43de-be1e-ad1f53da6055"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:17.706757 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2803753d-77ad-4524-8631-d920d295d869 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:17.713701 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2803753d-77ad-4524-8631-d920d295d869 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:17.714156 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2803753d-77ad-4524-8631-d920d295d869 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:17.715485 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2803753d-77ad-4524-8631-d920d295d869 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:17.716081 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2803753d-77ad-4524-8631-d920d295d869 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:17.900067 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-598f8cc3-41c5-4415-b005-a121c2de2510 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:17.900673 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-598f8cc3-41c5-4415-b005-a121c2de2510 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:17.935314 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-598f8cc3-41c5-4415-b005-a121c2de2510 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:17.936399 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-598f8cc3-41c5-4415-b005-a121c2de2510 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:17.942055 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-598f8cc3-41c5-4415-b005-a121c2de2510 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:17.942819 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-598f8cc3-41c5-4415-b005-a121c2de2510 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:18.184541 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-598f8cc3-41c5-4415-b005-a121c2de2510 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:18.195689 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-598f8cc3-41c5-4415-b005-a121c2de2510 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.300633 Sep 24 03:34:18.196339 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 289/585] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:17 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:18.225959 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2803753d-77ad-4524-8631-d920d295d869 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.524835 Sep 24 03:34:18.229128 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 297/586] 10.222.0.18 () {62 vars in 1364 bytes} [Fri Sep 24 03:34:17 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/os-volume_attachments => generated 188 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:34:18.394500 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a70ece93-c2f2-42e8-970c-448879fd7bb9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:18.395304 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a70ece93-c2f2-42e8-970c-448879fd7bb9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:18.403115 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a70ece93-c2f2-42e8-970c-448879fd7bb9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:18.403968 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a70ece93-c2f2-42e8-970c-448879fd7bb9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:18.404939 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a70ece93-c2f2-42e8-970c-448879fd7bb9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:18.405531 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a70ece93-c2f2-42e8-970c-448879fd7bb9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:18.440372 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-57b2301c-24e5-416e-996d-9b61a23a085d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:18.441090 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-57b2301c-24e5-416e-996d-9b61a23a085d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:18.452065 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-57b2301c-24e5-416e-996d-9b61a23a085d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:18.452514 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-57b2301c-24e5-416e-996d-9b61a23a085d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:18.453301 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-57b2301c-24e5-416e-996d-9b61a23a085d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:18.453823 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-57b2301c-24e5-416e-996d-9b61a23a085d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:18.565455 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a70ece93-c2f2-42e8-970c-448879fd7bb9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action" status: 202 len: 0 microversion: 2.20 time: 0.174956 Sep 24 03:34:18.567346 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 290/587] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:34:18 2021] POST /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:34:18.574945 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5d9a0018-946f-4757-a4a8-91c1fe674121 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:18.575906 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5d9a0018-946f-4757-a4a8-91c1fe674121 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:18.583370 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5d9a0018-946f-4757-a4a8-91c1fe674121 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:18.584143 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5d9a0018-946f-4757-a4a8-91c1fe674121 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:18.585151 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5d9a0018-946f-4757-a4a8-91c1fe674121 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:18.585829 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5d9a0018-946f-4757-a4a8-91c1fe674121 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:18.676636 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-57b2301c-24e5-416e-996d-9b61a23a085d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:18.683851 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-57b2301c-24e5-416e-996d-9b61a23a085d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 200 len: 1513 microversion: 2.1 time: 0.247964 Sep 24 03:34:18.685160 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 298/588] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:18 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:18.771551 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-bd9c5dc1-3fa6-4267-9fd8-23f0223cc3d5 req-a5337e3b-2b30-44b7-8bdc-a5b39cd96802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e82aa7-3e22-4ec6-84e7-6042f04eb89f", "name": "network-vif-deleted", "tag": "ea6cc573-5c51-43c0-abd7-1bce694ffedf"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:18.773506 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:18.773506 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:34:18.794544 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-bd9c5dc1-3fa6-4267-9fd8-23f0223cc3d5 req-a5337e3b-2b30-44b7-8bdc-a5b39cd96802 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:18.795127 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-bd9c5dc1-3fa6-4267-9fd8-23f0223cc3d5 req-a5337e3b-2b30-44b7-8bdc-a5b39cd96802 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:18.811598 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-bd9c5dc1-3fa6-4267-9fd8-23f0223cc3d5 req-a5337e3b-2b30-44b7-8bdc-a5b39cd96802 service nova] Creating event network-vif-deleted:ea6cc573-5c51-43c0-abd7-1bce694ffedf for instance 53e82aa7-3e22-4ec6-84e7-6042f04eb89f on hv-cinder-81080 Sep 24 03:34:18.832539 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-bd9c5dc1-3fa6-4267-9fd8-23f0223cc3d5 req-a5337e3b-2b30-44b7-8bdc-a5b39cd96802 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064151 Sep 24 03:34:18.837454 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 299/589] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:34:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:18.855911 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5d9a0018-946f-4757-a4a8-91c1fe674121 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:18.865701 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5d9a0018-946f-4757-a4a8-91c1fe674121 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:18.867224 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5d9a0018-946f-4757-a4a8-91c1fe674121 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:18.868386 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5d9a0018-946f-4757-a4a8-91c1fe674121 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1747 microversion: 2.20 time: 0.297100 Sep 24 03:34:18.882095 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 291/590] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:18 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1747 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:34:19.213370 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a68ce871-bf4e-4751-bc3f-4d2dd24e2cb7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:19.214429 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a68ce871-bf4e-4751-bc3f-4d2dd24e2cb7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:19.221268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a68ce871-bf4e-4751-bc3f-4d2dd24e2cb7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:19.221747 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a68ce871-bf4e-4751-bc3f-4d2dd24e2cb7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:19.222534 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a68ce871-bf4e-4751-bc3f-4d2dd24e2cb7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:19.222961 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a68ce871-bf4e-4751-bc3f-4d2dd24e2cb7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:19.405095 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a68ce871-bf4e-4751-bc3f-4d2dd24e2cb7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:19.417623 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a68ce871-bf4e-4751-bc3f-4d2dd24e2cb7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.207958 Sep 24 03:34:19.418237 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 300/591] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:19 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:19.701364 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d6318642-0fe2-47a5-b0f4-7961b909f42d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:19.702290 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d6318642-0fe2-47a5-b0f4-7961b909f42d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 53e82aa7-3e22-4ec6-84e7-6042f04eb89f] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:19.729467 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d6318642-0fe2-47a5-b0f4-7961b909f42d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:19.730037 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d6318642-0fe2-47a5-b0f4-7961b909f42d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:19.730818 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d6318642-0fe2-47a5-b0f4-7961b909f42d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:19.731243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d6318642-0fe2-47a5-b0f4-7961b909f42d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:19.763266 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-d6318642-0fe2-47a5-b0f4-7961b909f42d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] HTTP exception thrown: Instance 53e82aa7-3e22-4ec6-84e7-6042f04eb89f could not be found. Sep 24 03:34:19.763859 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d6318642-0fe2-47a5-b0f4-7961b909f42d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Returning 404 to user: Instance 53e82aa7-3e22-4ec6-84e7-6042f04eb89f could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:34:19.769339 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d6318642-0fe2-47a5-b0f4-7961b909f42d tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f" status: 404 len: 111 microversion: 2.1 time: 0.072237 Sep 24 03:34:19.771356 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 292/592] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:19 2021] GET /compute/v2.1/servers/53e82aa7-3e22-4ec6-84e7-6042f04eb89f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:34:19.891130 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7165efdd-b7a8-4e51-be2e-d42bc2ab0b4d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:19.893723 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-7165efdd-b7a8-4e51-be2e-d42bc2ab0b4d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:19.911190 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7165efdd-b7a8-4e51-be2e-d42bc2ab0b4d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:19.913591 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7165efdd-b7a8-4e51-be2e-d42bc2ab0b4d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:19.914454 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7165efdd-b7a8-4e51-be2e-d42bc2ab0b4d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:19.914885 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7165efdd-b7a8-4e51-be2e-d42bc2ab0b4d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:20.194767 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7165efdd-b7a8-4e51-be2e-d42bc2ab0b4d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:20.240373 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7165efdd-b7a8-4e51-be2e-d42bc2ab0b4d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:20.245961 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7165efdd-b7a8-4e51-be2e-d42bc2ab0b4d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:20.248334 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7165efdd-b7a8-4e51-be2e-d42bc2ab0b4d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1747 microversion: 2.20 time: 0.362018 Sep 24 03:34:20.250276 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 301/593] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:19 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1747 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:20.435441 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-457c8688-0243-4eb9-867d-ad911b061d7c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:20.436125 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-457c8688-0243-4eb9-867d-ad911b061d7c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:20.451412 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-457c8688-0243-4eb9-867d-ad911b061d7c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:20.451866 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-457c8688-0243-4eb9-867d-ad911b061d7c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:20.452659 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-457c8688-0243-4eb9-867d-ad911b061d7c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:20.453095 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-457c8688-0243-4eb9-867d-ad911b061d7c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:20.622930 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-457c8688-0243-4eb9-867d-ad911b061d7c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:20.632691 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-457c8688-0243-4eb9-867d-ad911b061d7c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.201272 Sep 24 03:34:20.633451 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 293/594] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:20 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:20.999968 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f7898628-29b6-43ff-a817-94e1714022f0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:21.002201 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f7898628-29b6-43ff-a817-94e1714022f0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:21.012203 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f7898628-29b6-43ff-a817-94e1714022f0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:21.012656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f7898628-29b6-43ff-a817-94e1714022f0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:21.013438 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f7898628-29b6-43ff-a817-94e1714022f0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:21.013897 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f7898628-29b6-43ff-a817-94e1714022f0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:21.040998 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f7898628-29b6-43ff-a817-94e1714022f0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Going to try to terminate instance {{(pid=109374) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:34:21.133737 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f7898628-29b6-43ff-a817-94e1714022f0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "DELETE /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 204 len: 0 microversion: 2.1 time: 0.137986 Sep 24 03:34:21.135229 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 302/595] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:34:20 2021] DELETE /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:34:21.142861 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-353809f4-d0c0-4b01-97a5-ed38bfcce316 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:21.143449 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-353809f4-d0c0-4b01-97a5-ed38bfcce316 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:21.149815 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-353809f4-d0c0-4b01-97a5-ed38bfcce316 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:21.150259 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-353809f4-d0c0-4b01-97a5-ed38bfcce316 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:21.151067 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-353809f4-d0c0-4b01-97a5-ed38bfcce316 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:21.151493 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-353809f4-d0c0-4b01-97a5-ed38bfcce316 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:21.269564 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-887514d9-7bae-443d-9189-7a6bc75a41ae tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:21.270465 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-887514d9-7bae-443d-9189-7a6bc75a41ae tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:21.278076 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-887514d9-7bae-443d-9189-7a6bc75a41ae tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:21.278785 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-887514d9-7bae-443d-9189-7a6bc75a41ae tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:21.279887 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-887514d9-7bae-443d-9189-7a6bc75a41ae tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:21.280583 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-887514d9-7bae-443d-9189-7a6bc75a41ae tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:21.294173 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-353809f4-d0c0-4b01-97a5-ed38bfcce316 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:21.302808 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-353809f4-d0c0-4b01-97a5-ed38bfcce316 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1513 microversion: 2.1 time: 0.163577 Sep 24 03:34:21.307537 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 294/596] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:21 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:21.436850 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-887514d9-7bae-443d-9189-7a6bc75a41ae tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:21.446598 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-887514d9-7bae-443d-9189-7a6bc75a41ae tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:21.448375 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-887514d9-7bae-443d-9189-7a6bc75a41ae tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:21.449566 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-887514d9-7bae-443d-9189-7a6bc75a41ae tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1749 microversion: 2.20 time: 0.184902 Sep 24 03:34:21.450322 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 303/597] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:21 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1749 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:21.655302 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-125f6ce0-e1a2-4ea3-bad7-7ea99311ea93 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:21.656199 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-125f6ce0-e1a2-4ea3-bad7-7ea99311ea93 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:21.663322 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-125f6ce0-e1a2-4ea3-bad7-7ea99311ea93 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:21.664058 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-125f6ce0-e1a2-4ea3-bad7-7ea99311ea93 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:21.677115 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-125f6ce0-e1a2-4ea3-bad7-7ea99311ea93 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:21.678403 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-125f6ce0-e1a2-4ea3-bad7-7ea99311ea93 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:21.861654 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-125f6ce0-e1a2-4ea3-bad7-7ea99311ea93 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:21.871292 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-125f6ce0-e1a2-4ea3-bad7-7ea99311ea93 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1567 microversion: 2.1 time: 0.219877 Sep 24 03:34:21.872498 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 295/598] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:21 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:22.320397 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d6981761-b5cc-4ca6-8cee-12d23e7afe0a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:22.322450 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d6981761-b5cc-4ca6-8cee-12d23e7afe0a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:22.332833 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d6981761-b5cc-4ca6-8cee-12d23e7afe0a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:22.333284 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d6981761-b5cc-4ca6-8cee-12d23e7afe0a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:22.334318 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d6981761-b5cc-4ca6-8cee-12d23e7afe0a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:22.334751 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d6981761-b5cc-4ca6-8cee-12d23e7afe0a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:22.468872 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d08fdfd9-4177-4d03-86c1-39520d4a8b0a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:22.470481 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d08fdfd9-4177-4d03-86c1-39520d4a8b0a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:22.477469 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d08fdfd9-4177-4d03-86c1-39520d4a8b0a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:22.477956 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d08fdfd9-4177-4d03-86c1-39520d4a8b0a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:22.478716 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d08fdfd9-4177-4d03-86c1-39520d4a8b0a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:22.479328 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d08fdfd9-4177-4d03-86c1-39520d4a8b0a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:22.552035 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d6981761-b5cc-4ca6-8cee-12d23e7afe0a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:22.571456 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d6981761-b5cc-4ca6-8cee-12d23e7afe0a tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1513 microversion: 2.1 time: 0.254846 Sep 24 03:34:22.572848 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 304/599] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:22 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:22.629978 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0edf21a8-2394-41d0-9d8e-c9dfc6e97155 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:22.630601 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0edf21a8-2394-41d0-9d8e-c9dfc6e97155 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:22.658897 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0edf21a8-2394-41d0-9d8e-c9dfc6e97155 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:22.659591 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0edf21a8-2394-41d0-9d8e-c9dfc6e97155 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:22.660521 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0edf21a8-2394-41d0-9d8e-c9dfc6e97155 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:22.661128 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0edf21a8-2394-41d0-9d8e-c9dfc6e97155 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:22.669233 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d08fdfd9-4177-4d03-86c1-39520d4a8b0a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:22.683196 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d08fdfd9-4177-4d03-86c1-39520d4a8b0a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:22.686067 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d08fdfd9-4177-4d03-86c1-39520d4a8b0a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:22.689391 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d08fdfd9-4177-4d03-86c1-39520d4a8b0a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1749 microversion: 2.20 time: 0.222599 Sep 24 03:34:22.700992 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 296/600] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:22 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1749 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:22.819356 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0edf21a8-2394-41d0-9d8e-c9dfc6e97155 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:22.828239 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0edf21a8-2394-41d0-9d8e-c9dfc6e97155 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1596 microversion: 2.1 time: 0.203265 Sep 24 03:34:22.838170 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 305/601] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:22 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1596 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:22.889864 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-851da56f-1c43-484b-b13a-e16c9ebc6e58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:22.890739 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-851da56f-1c43-484b-b13a-e16c9ebc6e58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:22.897538 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-851da56f-1c43-484b-b13a-e16c9ebc6e58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:22.899328 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-851da56f-1c43-484b-b13a-e16c9ebc6e58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:22.900333 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-851da56f-1c43-484b-b13a-e16c9ebc6e58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:22.901150 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-851da56f-1c43-484b-b13a-e16c9ebc6e58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:23.109290 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-851da56f-1c43-484b-b13a-e16c9ebc6e58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:23.132713 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-851da56f-1c43-484b-b13a-e16c9ebc6e58 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1547 microversion: 2.1 time: 0.246124 Sep 24 03:34:23.143394 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 297/602] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:22 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1547 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:23.171741 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9b8dc4cb-31e1-4b00-b383-b91a7885faff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:23.172214 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9b8dc4cb-31e1-4b00-b383-b91a7885faff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:23.179208 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9b8dc4cb-31e1-4b00-b383-b91a7885faff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:23.180302 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9b8dc4cb-31e1-4b00-b383-b91a7885faff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:23.181157 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9b8dc4cb-31e1-4b00-b383-b91a7885faff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:23.181741 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9b8dc4cb-31e1-4b00-b383-b91a7885faff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:23.383523 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-9b8dc4cb-31e1-4b00-b383-b91a7885faff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] HTTP exception thrown: Cannot 'detach_volume' instance 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 while it is in vm_state rescued Sep 24 03:34:23.384201 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9b8dc4cb-31e1-4b00-b383-b91a7885faff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Returning 409 to user: Cannot 'detach_volume' instance 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 while it is in vm_state rescued {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:34:23.386182 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9b8dc4cb-31e1-4b00-b383-b91a7885faff tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments/5d068612-3557-43e2-ba05-9c7fbb4f65e8" status: 409 len: 152 microversion: 2.1 time: 0.226177 Sep 24 03:34:23.387666 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 306/603] 10.222.0.18 () {58 vars in 1416 bytes} [Fri Sep 24 03:34:23 2021] DELETE /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments/5d068612-3557-43e2-ba05-9c7fbb4f65e8 => generated 152 bytes in 228 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 03:34:23.396562 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-fe6bd50f-7fa7-4e49-b5ab-79ad8b6992af tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:23.397475 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-fe6bd50f-7fa7-4e49-b5ab-79ad8b6992af tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:23.405383 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fe6bd50f-7fa7-4e49-b5ab-79ad8b6992af tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:23.406410 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fe6bd50f-7fa7-4e49-b5ab-79ad8b6992af tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:23.408538 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fe6bd50f-7fa7-4e49-b5ab-79ad8b6992af tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:23.409180 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fe6bd50f-7fa7-4e49-b5ab-79ad8b6992af tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:23.524287 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-fe6bd50f-7fa7-4e49-b5ab-79ad8b6992af tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "POST /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/action" status: 202 len: 0 microversion: 2.1 time: 0.132337 Sep 24 03:34:23.529498 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 298/604] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:34:23 2021] POST /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:34:23.536817 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-846a669b-7455-4a41-ab4c-b63439fce909 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:23.540037 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-846a669b-7455-4a41-ab4c-b63439fce909 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:23.549671 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-846a669b-7455-4a41-ab4c-b63439fce909 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:23.550721 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-846a669b-7455-4a41-ab4c-b63439fce909 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:23.551929 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-846a669b-7455-4a41-ab4c-b63439fce909 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:23.552700 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-846a669b-7455-4a41-ab4c-b63439fce909 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:23.590298 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8ec0988b-b3f6-435f-ab31-0777c5305cd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:23.592623 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8ec0988b-b3f6-435f-ab31-0777c5305cd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:23.600392 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ec0988b-b3f6-435f-ab31-0777c5305cd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:23.601036 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ec0988b-b3f6-435f-ab31-0777c5305cd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:23.601952 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ec0988b-b3f6-435f-ab31-0777c5305cd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:23.602868 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ec0988b-b3f6-435f-ab31-0777c5305cd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:23.938751 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-846a669b-7455-4a41-ab4c-b63439fce909 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:23.946962 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-846a669b-7455-4a41-ab4c-b63439fce909 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1555 microversion: 2.1 time: 0.416653 Sep 24 03:34:23.958426 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 307/605] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:23 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1555 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:23.958426 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-56bb38d2-cf1e-49c8-9c6d-003247638903 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:23.958426 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-56bb38d2-cf1e-49c8-9c6d-003247638903 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:23.960021 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-56bb38d2-cf1e-49c8-9c6d-003247638903 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:23.960469 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-56bb38d2-cf1e-49c8-9c6d-003247638903 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:23.963607 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-56bb38d2-cf1e-49c8-9c6d-003247638903 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:23.963607 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-56bb38d2-cf1e-49c8-9c6d-003247638903 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:24.128510 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8ec0988b-b3f6-435f-ab31-0777c5305cd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:24.136529 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8ec0988b-b3f6-435f-ab31-0777c5305cd0 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1513 microversion: 2.1 time: 0.551903 Sep 24 03:34:24.145550 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 299/606] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:23 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1513 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:24.383700 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-56bb38d2-cf1e-49c8-9c6d-003247638903 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:24.392517 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-56bb38d2-cf1e-49c8-9c6d-003247638903 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:24.394054 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-56bb38d2-cf1e-49c8-9c6d-003247638903 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:24.395227 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-56bb38d2-cf1e-49c8-9c6d-003247638903 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.446361 Sep 24 03:34:24.395789 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 308/607] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:23 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:24.693942 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-1aafc5a2-34ef-41b4-bb5a-7f5677124293 req-6b580683-dd53-4a87-ad72-30596d01d9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c68dca-6afe-4e74-9291-542e2d0529b4", "name": "network-vif-deleted", "tag": "8986b042-420b-4efa-b1f8-2c2d72fc703a"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:24.696632 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:24.696632 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:34:24.711097 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-1aafc5a2-34ef-41b4-bb5a-7f5677124293 req-6b580683-dd53-4a87-ad72-30596d01d9b1 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:24.714879 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-1aafc5a2-34ef-41b4-bb5a-7f5677124293 req-6b580683-dd53-4a87-ad72-30596d01d9b1 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:24.743933 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-1aafc5a2-34ef-41b4-bb5a-7f5677124293 req-6b580683-dd53-4a87-ad72-30596d01d9b1 service nova] Creating event network-vif-deleted:8986b042-420b-4efa-b1f8-2c2d72fc703a for instance 92c68dca-6afe-4e74-9291-542e2d0529b4 on hv-cinder-81080 Sep 24 03:34:24.756523 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-1aafc5a2-34ef-41b4-bb5a-7f5677124293 req-6b580683-dd53-4a87-ad72-30596d01d9b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067483 Sep 24 03:34:24.757705 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 300/608] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:34:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:24.966530 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-aa4c5bd6-2ee3-49c7-9a3b-b1952ce556d0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:24.967146 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-aa4c5bd6-2ee3-49c7-9a3b-b1952ce556d0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:24.975083 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa4c5bd6-2ee3-49c7-9a3b-b1952ce556d0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:24.975540 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa4c5bd6-2ee3-49c7-9a3b-b1952ce556d0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:24.980119 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa4c5bd6-2ee3-49c7-9a3b-b1952ce556d0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:24.980394 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa4c5bd6-2ee3-49c7-9a3b-b1952ce556d0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:25.162243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-670015c1-fd53-4bb3-9499-c4935b7f97bb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:25.163065 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-670015c1-fd53-4bb3-9499-c4935b7f97bb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:25.175007 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-670015c1-fd53-4bb3-9499-c4935b7f97bb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:25.177677 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-670015c1-fd53-4bb3-9499-c4935b7f97bb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:25.179532 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-670015c1-fd53-4bb3-9499-c4935b7f97bb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:25.182301 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-670015c1-fd53-4bb3-9499-c4935b7f97bb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:25.288989 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-670015c1-fd53-4bb3-9499-c4935b7f97bb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:25.296127 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-670015c1-fd53-4bb3-9499-c4935b7f97bb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:25.298854 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-670015c1-fd53-4bb3-9499-c4935b7f97bb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lazy-loading 'fault' on Instance uuid 92c68dca-6afe-4e74-9291-542e2d0529b4 {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:34:25.323906 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-aa4c5bd6-2ee3-49c7-9a3b-b1952ce556d0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:25.333524 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-aa4c5bd6-2ee3-49c7-9a3b-b1952ce556d0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1555 microversion: 2.1 time: 0.371571 Sep 24 03:34:25.339343 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 309/609] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:24 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1555 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:25.379377 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-670015c1-fd53-4bb3-9499-c4935b7f97bb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:25.387263 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-670015c1-fd53-4bb3-9499-c4935b7f97bb tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1307 microversion: 2.1 time: 0.229218 Sep 24 03:34:25.388205 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 301/610] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:25 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:25.413089 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-756c1981-4978-4f48-a3c6-54c2bda36b63 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:25.413615 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-756c1981-4978-4f48-a3c6-54c2bda36b63 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:25.424232 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-756c1981-4978-4f48-a3c6-54c2bda36b63 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:25.424679 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-756c1981-4978-4f48-a3c6-54c2bda36b63 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:25.425481 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-756c1981-4978-4f48-a3c6-54c2bda36b63 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:25.425949 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-756c1981-4978-4f48-a3c6-54c2bda36b63 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:25.846251 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-756c1981-4978-4f48-a3c6-54c2bda36b63 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:25.869195 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-756c1981-4978-4f48-a3c6-54c2bda36b63 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:25.873536 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-756c1981-4978-4f48-a3c6-54c2bda36b63 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:25.878627 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-756c1981-4978-4f48-a3c6-54c2bda36b63 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.469175 Sep 24 03:34:25.880677 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 310/611] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:25 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:26.357069 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-19fcfb32-56e5-4acd-b22d-9b12be661455 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:26.359019 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-19fcfb32-56e5-4acd-b22d-9b12be661455 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:26.383801 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-19fcfb32-56e5-4acd-b22d-9b12be661455 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:26.385193 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-19fcfb32-56e5-4acd-b22d-9b12be661455 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:26.385193 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-19fcfb32-56e5-4acd-b22d-9b12be661455 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:26.385383 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-19fcfb32-56e5-4acd-b22d-9b12be661455 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:26.412614 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d23ca28e-9d20-4dee-85e9-dd6a40f398bf tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:26.414272 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d23ca28e-9d20-4dee-85e9-dd6a40f398bf tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:26.458416 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d23ca28e-9d20-4dee-85e9-dd6a40f398bf tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:26.461021 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d23ca28e-9d20-4dee-85e9-dd6a40f398bf tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:26.462232 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d23ca28e-9d20-4dee-85e9-dd6a40f398bf tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:26.464210 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d23ca28e-9d20-4dee-85e9-dd6a40f398bf tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:26.583420 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d23ca28e-9d20-4dee-85e9-dd6a40f398bf tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:26.584365 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d23ca28e-9d20-4dee-85e9-dd6a40f398bf tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:26.585879 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.objects.instance [None req-d23ca28e-9d20-4dee-85e9-dd6a40f398bf tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lazy-loading 'fault' on Instance uuid 92c68dca-6afe-4e74-9291-542e2d0529b4 {{(pid=109374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:34:26.722253 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d23ca28e-9d20-4dee-85e9-dd6a40f398bf tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332a6e416a1347d8927b2d48cc37ac37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad76815db3c4a67adf42217edb51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:26.733255 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d23ca28e-9d20-4dee-85e9-dd6a40f398bf tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 200 len: 1307 microversion: 2.1 time: 0.324528 Sep 24 03:34:26.734437 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 311/612] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:26 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 1307 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:26.746669 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-0d8ac018-de93-4016-b09e-c791d1c9c9be req-1acebb4a-c941-4a9f-bc23-490cc25b0e58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f970df3c-ce7a-4c9c-9564-0a3707e53696", "tag": "e6ac50dd-759d-45ec-baea-edee8c9c243d"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:26.753520 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:26.753520 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:34:26.775817 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-0d8ac018-de93-4016-b09e-c791d1c9c9be req-1acebb4a-c941-4a9f-bc23-490cc25b0e58 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:26.778654 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-0d8ac018-de93-4016-b09e-c791d1c9c9be req-1acebb4a-c941-4a9f-bc23-490cc25b0e58 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:26.821331 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-0d8ac018-de93-4016-b09e-c791d1c9c9be req-1acebb4a-c941-4a9f-bc23-490cc25b0e58 service nova] Creating event network-changed:e6ac50dd-759d-45ec-baea-edee8c9c243d for instance f970df3c-ce7a-4c9c-9564-0a3707e53696 on hv-cinder-81080 Sep 24 03:34:26.839563 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-0d8ac018-de93-4016-b09e-c791d1c9c9be req-1acebb4a-c941-4a9f-bc23-490cc25b0e58 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101350 Sep 24 03:34:26.862847 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 312/613] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:34:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:26.903814 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1ba2743a-6aa3-453b-92e1-40b2d8a09d88 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:26.905063 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1ba2743a-6aa3-453b-92e1-40b2d8a09d88 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:26.934432 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1ba2743a-6aa3-453b-92e1-40b2d8a09d88 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:26.936940 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1ba2743a-6aa3-453b-92e1-40b2d8a09d88 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:26.943637 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1ba2743a-6aa3-453b-92e1-40b2d8a09d88 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:26.951351 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1ba2743a-6aa3-453b-92e1-40b2d8a09d88 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:27.310136 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-19fcfb32-56e5-4acd-b22d-9b12be661455 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:27.343065 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-19fcfb32-56e5-4acd-b22d-9b12be661455 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1555 microversion: 2.1 time: 0.990132 Sep 24 03:34:27.343780 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 302/614] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:26 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1555 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:27.653892 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1ba2743a-6aa3-453b-92e1-40b2d8a09d88 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:27.687060 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1ba2743a-6aa3-453b-92e1-40b2d8a09d88 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:27.690035 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1ba2743a-6aa3-453b-92e1-40b2d8a09d88 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:27.695299 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1ba2743a-6aa3-453b-92e1-40b2d8a09d88 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.799165 Sep 24 03:34:27.702727 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 313/615] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:26 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:27.753371 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f4339784-06ad-4359-850a-4917f352ea24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:27.754734 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f4339784-06ad-4359-850a-4917f352ea24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] [instance: 92c68dca-6afe-4e74-9291-542e2d0529b4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:27.793295 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f4339784-06ad-4359-850a-4917f352ea24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:27.794285 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f4339784-06ad-4359-850a-4917f352ea24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:27.796923 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f4339784-06ad-4359-850a-4917f352ea24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:27.800716 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f4339784-06ad-4359-850a-4917f352ea24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:27.838782 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-f4339784-06ad-4359-850a-4917f352ea24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] HTTP exception thrown: Instance 92c68dca-6afe-4e74-9291-542e2d0529b4 could not be found. Sep 24 03:34:27.842396 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f4339784-06ad-4359-850a-4917f352ea24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] Returning 404 to user: Instance 92c68dca-6afe-4e74-9291-542e2d0529b4 could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:34:27.845123 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f4339784-06ad-4359-850a-4917f352ea24 tempest-AttachVolumeNegativeTest-304679691 tempest-AttachVolumeNegativeTest-304679691-project] 10.222.0.18 "GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4" status: 404 len: 111 microversion: 2.1 time: 0.096770 Sep 24 03:34:27.846663 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 303/616] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:27 2021] GET /compute/v2.1/servers/92c68dca-6afe-4e74-9291-542e2d0529b4 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:34:28.360893 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c7e25df7-0f07-4b7b-9633-265c1e4b42c7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:28.361503 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c7e25df7-0f07-4b7b-9633-265c1e4b42c7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:28.375018 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7e25df7-0f07-4b7b-9633-265c1e4b42c7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:28.376275 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7e25df7-0f07-4b7b-9633-265c1e4b42c7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:28.380622 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7e25df7-0f07-4b7b-9633-265c1e4b42c7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:28.381071 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7e25df7-0f07-4b7b-9633-265c1e4b42c7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:28.720873 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-56b0bb66-0e63-4773-a842-99f110751d3c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:28.722225 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-56b0bb66-0e63-4773-a842-99f110751d3c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:28.748720 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-56b0bb66-0e63-4773-a842-99f110751d3c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:28.750775 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-56b0bb66-0e63-4773-a842-99f110751d3c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:28.756386 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-56b0bb66-0e63-4773-a842-99f110751d3c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:28.772757 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-56b0bb66-0e63-4773-a842-99f110751d3c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:28.773868 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c7e25df7-0f07-4b7b-9633-265c1e4b42c7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:28.792600 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c7e25df7-0f07-4b7b-9633-265c1e4b42c7 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1561 microversion: 2.1 time: 0.432399 Sep 24 03:34:28.808443 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 314/617] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:28 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1561 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:28.981464 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4abcdde3-7f74-4458-90ed-8d4d8abaeab5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:28.982572 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4abcdde3-7f74-4458-90ed-8d4d8abaeab5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:28.990206 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4abcdde3-7f74-4458-90ed-8d4d8abaeab5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:28.990914 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4abcdde3-7f74-4458-90ed-8d4d8abaeab5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:28.992375 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4abcdde3-7f74-4458-90ed-8d4d8abaeab5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:28.992942 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4abcdde3-7f74-4458-90ed-8d4d8abaeab5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:29.093308 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-56b0bb66-0e63-4773-a842-99f110751d3c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:29.103299 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.objects.instance [None req-4abcdde3-7f74-4458-90ed-8d4d8abaeab5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lazy-loading 'services' on Instance uuid 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 {{(pid=109374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:34:29.106605 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-56b0bb66-0e63-4773-a842-99f110751d3c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:29.118824 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-56b0bb66-0e63-4773-a842-99f110751d3c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:29.122751 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-56b0bb66-0e63-4773-a842-99f110751d3c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.406374 Sep 24 03:34:29.124238 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 304/618] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:28 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:34:29.292490 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4abcdde3-7f74-4458-90ed-8d4d8abaeab5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments/5d068612-3557-43e2-ba05-9c7fbb4f65e8" status: 202 len: 0 microversion: 2.1 time: 0.312803 Sep 24 03:34:29.302089 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-75aaa89b-ee50-4715-a369-799dd78f7938 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:29.303300 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-75aaa89b-ee50-4715-a369-799dd78f7938 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:29.307044 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 315/619] 10.222.0.18 () {58 vars in 1416 bytes} [Fri Sep 24 03:34:28 2021] DELETE /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments/5d068612-3557-43e2-ba05-9c7fbb4f65e8 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:34:29.314908 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-75aaa89b-ee50-4715-a369-799dd78f7938 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:29.319766 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-75aaa89b-ee50-4715-a369-799dd78f7938 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:29.321605 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-75aaa89b-ee50-4715-a369-799dd78f7938 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:29.323643 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-75aaa89b-ee50-4715-a369-799dd78f7938 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:29.380329 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-75aaa89b-ee50-4715-a369-799dd78f7938 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082034 Sep 24 03:34:29.384740 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 305/620] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:34:29 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:29.617792 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a2db7318-f2df-4cbd-ac5a-f494cb7de4f3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-544611027"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:29.617792 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a2db7318-f2df-4cbd-ac5a-f494cb7de4f3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:29.639074 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a2db7318-f2df-4cbd-ac5a-f494cb7de4f3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:29.639518 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a2db7318-f2df-4cbd-ac5a-f494cb7de4f3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:29.640305 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a2db7318-f2df-4cbd-ac5a-f494cb7de4f3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:29.640733 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a2db7318-f2df-4cbd-ac5a-f494cb7de4f3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:29.784842 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.network.security_group_api [None req-a2db7318-f2df-4cbd-ac5a-f494cb7de4f3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Adding security group c3b936ff-f3a7-430e-bd2d-055c78a4b061 to port e6ac50dd-759d-45ec-baea-edee8c9c243d Sep 24 03:34:30.148494 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1e9ab2c4-6fd8-47de-847b-b46904d34fdf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:30.148494 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1e9ab2c4-6fd8-47de-847b-b46904d34fdf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:30.155924 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1e9ab2c4-6fd8-47de-847b-b46904d34fdf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:30.157596 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1e9ab2c4-6fd8-47de-847b-b46904d34fdf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:30.159209 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1e9ab2c4-6fd8-47de-847b-b46904d34fdf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:30.159843 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1e9ab2c4-6fd8-47de-847b-b46904d34fdf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:30.358455 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a2db7318-f2df-4cbd-ac5a-f494cb7de4f3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "POST /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/action" status: 202 len: 0 microversion: 2.1 time: 0.762145 Sep 24 03:34:30.359152 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 316/621] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:34:29 2021] POST /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/action => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:34:30.369444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-30d56f6d-112e-4107-8257-1abd6416dc61 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:30.370116 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-30d56f6d-112e-4107-8257-1abd6416dc61 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:30.386061 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30d56f6d-112e-4107-8257-1abd6416dc61 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:30.386500 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30d56f6d-112e-4107-8257-1abd6416dc61 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:30.389060 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30d56f6d-112e-4107-8257-1abd6416dc61 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:30.403301 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30d56f6d-112e-4107-8257-1abd6416dc61 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:30.593617 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1e9ab2c4-6fd8-47de-847b-b46904d34fdf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:30.606581 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1e9ab2c4-6fd8-47de-847b-b46904d34fdf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:30.616606 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1e9ab2c4-6fd8-47de-847b-b46904d34fdf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:30.617921 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1e9ab2c4-6fd8-47de-847b-b46904d34fdf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.479465 Sep 24 03:34:30.626140 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 306/622] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:30 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:30.639390 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-103d78c8-9dc7-40c4-a256-2192806ab962 req-5507a0ea-870d-49c2-a158-fc9de6fcf36a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f970df3c-ce7a-4c9c-9564-0a3707e53696", "tag": "e6ac50dd-759d-45ec-baea-edee8c9c243d"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:30.643979 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:30.643979 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:34:30.659239 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-103d78c8-9dc7-40c4-a256-2192806ab962 req-5507a0ea-870d-49c2-a158-fc9de6fcf36a service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:30.660904 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-103d78c8-9dc7-40c4-a256-2192806ab962 req-5507a0ea-870d-49c2-a158-fc9de6fcf36a service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:30.691519 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-103d78c8-9dc7-40c4-a256-2192806ab962 req-5507a0ea-870d-49c2-a158-fc9de6fcf36a service nova] Creating event network-changed:e6ac50dd-759d-45ec-baea-edee8c9c243d for instance f970df3c-ce7a-4c9c-9564-0a3707e53696 on hv-cinder-81080 Sep 24 03:34:30.705669 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-103d78c8-9dc7-40c4-a256-2192806ab962 req-5507a0ea-870d-49c2-a158-fc9de6fcf36a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072777 Sep 24 03:34:30.708759 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 307/623] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:34:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:30.721968 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3ea40b0e-6c9c-4267-bf61-1f024340e78e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:30.723359 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3ea40b0e-6c9c-4267-bf61-1f024340e78e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:30.728954 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-30d56f6d-112e-4107-8257-1abd6416dc61 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:30.736206 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ea40b0e-6c9c-4267-bf61-1f024340e78e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:30.736763 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ea40b0e-6c9c-4267-bf61-1f024340e78e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:30.737644 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ea40b0e-6c9c-4267-bf61-1f024340e78e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:30.738196 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ea40b0e-6c9c-4267-bf61-1f024340e78e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:30.738722 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-30d56f6d-112e-4107-8257-1abd6416dc61 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1642 microversion: 2.1 time: 0.374274 Sep 24 03:34:30.739307 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 317/624] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:30 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1642 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:30.792862 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3ea40b0e-6c9c-4267-bf61-1f024340e78e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082450 Sep 24 03:34:30.796183 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 308/625] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:34:30 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:31.636051 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2b92eada-a18e-44e9-a4b5-61019b88ee8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:31.636687 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2b92eada-a18e-44e9-a4b5-61019b88ee8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:31.642755 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2b92eada-a18e-44e9-a4b5-61019b88ee8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:31.643194 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2b92eada-a18e-44e9-a4b5-61019b88ee8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:31.643949 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2b92eada-a18e-44e9-a4b5-61019b88ee8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:31.644371 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2b92eada-a18e-44e9-a4b5-61019b88ee8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:31.822010 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2b92eada-a18e-44e9-a4b5-61019b88ee8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:31.823099 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-018ec0cc-b412-4663-bf6c-2efec6937408 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:31.824009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-018ec0cc-b412-4663-bf6c-2efec6937408 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:31.832998 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-018ec0cc-b412-4663-bf6c-2efec6937408 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:31.833875 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-018ec0cc-b412-4663-bf6c-2efec6937408 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:31.835147 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-018ec0cc-b412-4663-bf6c-2efec6937408 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:31.835736 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-018ec0cc-b412-4663-bf6c-2efec6937408 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:31.837400 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2b92eada-a18e-44e9-a4b5-61019b88ee8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:31.839738 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2b92eada-a18e-44e9-a4b5-61019b88ee8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:31.841228 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2b92eada-a18e-44e9-a4b5-61019b88ee8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.208928 Sep 24 03:34:31.842083 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 318/626] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:31 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:31.880439 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-018ec0cc-b412-4663-bf6c-2efec6937408 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061258 Sep 24 03:34:31.881012 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 309/627] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:34:31 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:32.870562 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b7f3a159-221c-4f91-91ab-0469a738c905 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:32.871594 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b7f3a159-221c-4f91-91ab-0469a738c905 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:32.880767 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b7f3a159-221c-4f91-91ab-0469a738c905 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:32.883699 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b7f3a159-221c-4f91-91ab-0469a738c905 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:32.889511 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b7f3a159-221c-4f91-91ab-0469a738c905 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:32.890112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b7f3a159-221c-4f91-91ab-0469a738c905 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:32.892795 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-37685cb6-bfa9-4e01-a120-c3ff2e400273 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:32.894051 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-37685cb6-bfa9-4e01-a120-c3ff2e400273 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:32.902547 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-37685cb6-bfa9-4e01-a120-c3ff2e400273 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:32.903537 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-37685cb6-bfa9-4e01-a120-c3ff2e400273 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:32.904996 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-37685cb6-bfa9-4e01-a120-c3ff2e400273 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:32.905889 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-37685cb6-bfa9-4e01-a120-c3ff2e400273 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:32.974129 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-37685cb6-bfa9-4e01-a120-c3ff2e400273 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085876 Sep 24 03:34:32.975430 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 310/628] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:34:32 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:34:33.082996 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b7f3a159-221c-4f91-91ab-0469a738c905 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:33.097572 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b7f3a159-221c-4f91-91ab-0469a738c905 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:33.099581 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b7f3a159-221c-4f91-91ab-0469a738c905 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:33.101114 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b7f3a159-221c-4f91-91ab-0469a738c905 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.238177 Sep 24 03:34:33.115258 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 319/629] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:32 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:33.987397 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ea7fb716-6a8c-4873-809b-6bcd6cf2f60e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:33.988799 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ea7fb716-6a8c-4873-809b-6bcd6cf2f60e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:33.995537 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ea7fb716-6a8c-4873-809b-6bcd6cf2f60e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:33.996274 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ea7fb716-6a8c-4873-809b-6bcd6cf2f60e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:33.997979 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ea7fb716-6a8c-4873-809b-6bcd6cf2f60e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:33.998635 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ea7fb716-6a8c-4873-809b-6bcd6cf2f60e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:34.054846 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ea7fb716-6a8c-4873-809b-6bcd6cf2f60e tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072762 Sep 24 03:34:34.056002 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 311/630] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:34:33 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:34.121756 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a4171b1c-92b5-4d00-be2e-21ef169b1e12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:34.122348 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a4171b1c-92b5-4d00-be2e-21ef169b1e12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:34.128944 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a4171b1c-92b5-4d00-be2e-21ef169b1e12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:34.129396 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a4171b1c-92b5-4d00-be2e-21ef169b1e12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:34.130292 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a4171b1c-92b5-4d00-be2e-21ef169b1e12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:34.130617 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a4171b1c-92b5-4d00-be2e-21ef169b1e12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:34.298600 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a4171b1c-92b5-4d00-be2e-21ef169b1e12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:34.310786 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a4171b1c-92b5-4d00-be2e-21ef169b1e12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:34.316792 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a4171b1c-92b5-4d00-be2e-21ef169b1e12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:34.318152 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a4171b1c-92b5-4d00-be2e-21ef169b1e12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.200064 Sep 24 03:34:34.330520 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 320/631] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:34 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:35.069041 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-dc8d90e7-ce20-46d1-b654-4098868eefeb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:35.070197 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-dc8d90e7-ce20-46d1-b654-4098868eefeb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:35.081231 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dc8d90e7-ce20-46d1-b654-4098868eefeb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:35.081674 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dc8d90e7-ce20-46d1-b654-4098868eefeb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:35.082493 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dc8d90e7-ce20-46d1-b654-4098868eefeb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:35.082909 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dc8d90e7-ce20-46d1-b654-4098868eefeb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:35.129977 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-dc8d90e7-ce20-46d1-b654-4098868eefeb tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065094 Sep 24 03:34:35.130659 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 312/632] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:34:35 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:35.336860 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8bd4147d-1528-4a6f-a573-6700e7639668 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:35.338142 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8bd4147d-1528-4a6f-a573-6700e7639668 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:35.344178 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8bd4147d-1528-4a6f-a573-6700e7639668 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:35.344584 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8bd4147d-1528-4a6f-a573-6700e7639668 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:35.345745 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8bd4147d-1528-4a6f-a573-6700e7639668 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:35.346320 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8bd4147d-1528-4a6f-a573-6700e7639668 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:35.540408 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8bd4147d-1528-4a6f-a573-6700e7639668 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:35.556130 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8bd4147d-1528-4a6f-a573-6700e7639668 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:35.557933 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8bd4147d-1528-4a6f-a573-6700e7639668 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:35.559260 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8bd4147d-1528-4a6f-a573-6700e7639668 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.226867 Sep 24 03:34:35.559991 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 321/633] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:35 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:34:36.141677 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-79fa5bcd-f0b6-4d33-9cbd-155637250e79 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:36.143583 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-79fa5bcd-f0b6-4d33-9cbd-155637250e79 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:36.149671 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-79fa5bcd-f0b6-4d33-9cbd-155637250e79 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:36.150146 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-79fa5bcd-f0b6-4d33-9cbd-155637250e79 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:36.150918 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-79fa5bcd-f0b6-4d33-9cbd-155637250e79 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:36.151344 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-79fa5bcd-f0b6-4d33-9cbd-155637250e79 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:36.183026 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-79fa5bcd-f0b6-4d33-9cbd-155637250e79 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045692 Sep 24 03:34:36.183589 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 313/634] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:34:36 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:36.578021 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6458e622-47f5-4339-b84c-61370541531f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:36.580179 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6458e622-47f5-4339-b84c-61370541531f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:36.592596 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6458e622-47f5-4339-b84c-61370541531f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:36.594671 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6458e622-47f5-4339-b84c-61370541531f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:36.595532 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6458e622-47f5-4339-b84c-61370541531f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:36.596067 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6458e622-47f5-4339-b84c-61370541531f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:36.783039 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6458e622-47f5-4339-b84c-61370541531f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:36.799643 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6458e622-47f5-4339-b84c-61370541531f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:36.801974 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6458e622-47f5-4339-b84c-61370541531f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:36.803578 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6458e622-47f5-4339-b84c-61370541531f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.229377 Sep 24 03:34:36.804581 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 322/635] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:36 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:37.206622 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6ffa2a9d-26a2-4367-9815-3e8d5f9cb7ce tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:37.207592 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6ffa2a9d-26a2-4367-9815-3e8d5f9cb7ce tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:37.213741 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6ffa2a9d-26a2-4367-9815-3e8d5f9cb7ce tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:37.214217 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6ffa2a9d-26a2-4367-9815-3e8d5f9cb7ce tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:37.214979 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6ffa2a9d-26a2-4367-9815-3e8d5f9cb7ce tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:37.215575 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6ffa2a9d-26a2-4367-9815-3e8d5f9cb7ce tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:37.246550 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6ffa2a9d-26a2-4367-9815-3e8d5f9cb7ce tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051460 Sep 24 03:34:37.251527 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 314/636] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:34:37 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:37.822187 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-075d51c1-19bb-47c6-81dc-edab1ecdfb9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:37.822783 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-075d51c1-19bb-47c6-81dc-edab1ecdfb9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:37.831096 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-075d51c1-19bb-47c6-81dc-edab1ecdfb9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:37.831818 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-075d51c1-19bb-47c6-81dc-edab1ecdfb9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:37.836392 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-075d51c1-19bb-47c6-81dc-edab1ecdfb9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:37.837016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-075d51c1-19bb-47c6-81dc-edab1ecdfb9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:37.995862 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-075d51c1-19bb-47c6-81dc-edab1ecdfb9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:38.005992 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-075d51c1-19bb-47c6-81dc-edab1ecdfb9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:38.007632 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-075d51c1-19bb-47c6-81dc-edab1ecdfb9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:38.008793 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-075d51c1-19bb-47c6-81dc-edab1ecdfb9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.190421 Sep 24 03:34:38.009376 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 323/637] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:37 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:38.259000 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a4f30909-9d70-472c-85dc-fe0dd37f8e49 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:38.260460 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a4f30909-9d70-472c-85dc-fe0dd37f8e49 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:38.273126 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a4f30909-9d70-472c-85dc-fe0dd37f8e49 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:38.273577 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a4f30909-9d70-472c-85dc-fe0dd37f8e49 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:38.274386 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a4f30909-9d70-472c-85dc-fe0dd37f8e49 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:38.274815 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a4f30909-9d70-472c-85dc-fe0dd37f8e49 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:38.307302 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a4f30909-9d70-472c-85dc-fe0dd37f8e49 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052339 Sep 24 03:34:38.308225 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 315/638] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:34:38 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:39.077537 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d616b6ac-85ec-4a12-92f4-ec76fb15696f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:39.078285 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d616b6ac-85ec-4a12-92f4-ec76fb15696f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:39.084573 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d616b6ac-85ec-4a12-92f4-ec76fb15696f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:39.085112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d616b6ac-85ec-4a12-92f4-ec76fb15696f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:39.085982 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d616b6ac-85ec-4a12-92f4-ec76fb15696f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:39.086488 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d616b6ac-85ec-4a12-92f4-ec76fb15696f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:39.213884 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d616b6ac-85ec-4a12-92f4-ec76fb15696f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:39.223961 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d616b6ac-85ec-4a12-92f4-ec76fb15696f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:39.225504 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d616b6ac-85ec-4a12-92f4-ec76fb15696f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:39.226748 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d616b6ac-85ec-4a12-92f4-ec76fb15696f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.152955 Sep 24 03:34:39.227412 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 324/639] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:39 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:39.318549 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-58ba82ee-2662-4a73-abc9-5ec79f75d29a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:39.320179 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-58ba82ee-2662-4a73-abc9-5ec79f75d29a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:39.337025 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-58ba82ee-2662-4a73-abc9-5ec79f75d29a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:39.337754 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-58ba82ee-2662-4a73-abc9-5ec79f75d29a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:39.338898 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-58ba82ee-2662-4a73-abc9-5ec79f75d29a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:39.339571 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-58ba82ee-2662-4a73-abc9-5ec79f75d29a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:39.392878 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-58ba82ee-2662-4a73-abc9-5ec79f75d29a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073708 Sep 24 03:34:39.397401 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 316/640] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:34:39 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:34:40.246261 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c47ab94e-e302-4998-a1f8-f0e27ad054f6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:40.247144 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c47ab94e-e302-4998-a1f8-f0e27ad054f6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:40.253443 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c47ab94e-e302-4998-a1f8-f0e27ad054f6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:40.253914 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c47ab94e-e302-4998-a1f8-f0e27ad054f6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:40.254688 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c47ab94e-e302-4998-a1f8-f0e27ad054f6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:40.255120 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c47ab94e-e302-4998-a1f8-f0e27ad054f6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:40.383950 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c47ab94e-e302-4998-a1f8-f0e27ad054f6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:40.392224 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c47ab94e-e302-4998-a1f8-f0e27ad054f6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:40.393696 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c47ab94e-e302-4998-a1f8-f0e27ad054f6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:40.394851 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c47ab94e-e302-4998-a1f8-f0e27ad054f6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.152398 Sep 24 03:34:40.395401 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 325/641] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:40 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:40.403196 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-cb5062d2-0310-43fa-84c0-7df68a399770 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:40.404130 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-cb5062d2-0310-43fa-84c0-7df68a399770 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:40.411606 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cb5062d2-0310-43fa-84c0-7df68a399770 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:40.412047 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cb5062d2-0310-43fa-84c0-7df68a399770 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:40.412829 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cb5062d2-0310-43fa-84c0-7df68a399770 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:40.413255 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cb5062d2-0310-43fa-84c0-7df68a399770 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:40.443775 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-cb5062d2-0310-43fa-84c0-7df68a399770 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044356 Sep 24 03:34:40.444336 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 317/642] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:34:40 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:34:41.412763 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6e783c25-775c-4f10-8460-8d4324eac318 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:41.413356 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6e783c25-775c-4f10-8460-8d4324eac318 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:41.419352 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6e783c25-775c-4f10-8460-8d4324eac318 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:41.419799 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6e783c25-775c-4f10-8460-8d4324eac318 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:41.420586 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6e783c25-775c-4f10-8460-8d4324eac318 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:41.421013 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6e783c25-775c-4f10-8460-8d4324eac318 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:41.542636 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6e783c25-775c-4f10-8460-8d4324eac318 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:41.551664 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6e783c25-775c-4f10-8460-8d4324eac318 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:41.553136 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6e783c25-775c-4f10-8460-8d4324eac318 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:41.554373 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6e783c25-775c-4f10-8460-8d4324eac318 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.145344 Sep 24 03:34:41.554930 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 326/643] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:41 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:42.574342 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-21ebadfb-8a25-4a0b-af1c-194a2baecfda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:42.574982 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-21ebadfb-8a25-4a0b-af1c-194a2baecfda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:42.581608 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-21ebadfb-8a25-4a0b-af1c-194a2baecfda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:42.582007 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-21ebadfb-8a25-4a0b-af1c-194a2baecfda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:42.582877 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-21ebadfb-8a25-4a0b-af1c-194a2baecfda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:42.583340 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-21ebadfb-8a25-4a0b-af1c-194a2baecfda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:42.717504 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-21ebadfb-8a25-4a0b-af1c-194a2baecfda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:42.726461 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-21ebadfb-8a25-4a0b-af1c-194a2baecfda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:42.727953 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-21ebadfb-8a25-4a0b-af1c-194a2baecfda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:42.729107 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-21ebadfb-8a25-4a0b-af1c-194a2baecfda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.158826 Sep 24 03:34:42.729669 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 318/644] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:42 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:42.767625 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ab87f47d-82dd-49a8-9d30-55dfb16cd0a5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:42.768176 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ab87f47d-82dd-49a8-9d30-55dfb16cd0a5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:42.773952 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ab87f47d-82dd-49a8-9d30-55dfb16cd0a5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:42.774385 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ab87f47d-82dd-49a8-9d30-55dfb16cd0a5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:42.775152 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ab87f47d-82dd-49a8-9d30-55dfb16cd0a5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:42.775602 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ab87f47d-82dd-49a8-9d30-55dfb16cd0a5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:42.802090 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ab87f47d-82dd-49a8-9d30-55dfb16cd0a5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Going to try to terminate instance {{(pid=109374) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:34:42.882197 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ab87f47d-82dd-49a8-9d30-55dfb16cd0a5 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 204 len: 0 microversion: 2.1 time: 0.118259 Sep 24 03:34:42.885881 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 327/645] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:34:42 2021] DELETE /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:34:42.892480 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a63ca748-8738-422d-9696-43e60db9cf6c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:42.893110 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a63ca748-8738-422d-9696-43e60db9cf6c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:42.898920 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a63ca748-8738-422d-9696-43e60db9cf6c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:42.899354 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a63ca748-8738-422d-9696-43e60db9cf6c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:42.900549 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a63ca748-8738-422d-9696-43e60db9cf6c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:42.901141 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a63ca748-8738-422d-9696-43e60db9cf6c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:43.090951 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a63ca748-8738-422d-9696-43e60db9cf6c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:43.099760 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a63ca748-8738-422d-9696-43e60db9cf6c tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1507 microversion: 2.1 time: 0.212068 Sep 24 03:34:43.101766 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 319/646] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:42 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:43.749428 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-25127255-4367-45a9-b32c-ee10852120e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:43.751479 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-25127255-4367-45a9-b32c-ee10852120e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:43.758196 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-25127255-4367-45a9-b32c-ee10852120e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:43.758655 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-25127255-4367-45a9-b32c-ee10852120e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:43.759436 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-25127255-4367-45a9-b32c-ee10852120e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:43.759855 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-25127255-4367-45a9-b32c-ee10852120e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:43.896600 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-25127255-4367-45a9-b32c-ee10852120e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:43.908091 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-25127255-4367-45a9-b32c-ee10852120e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:43.909741 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-25127255-4367-45a9-b32c-ee10852120e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:43.912952 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-25127255-4367-45a9-b32c-ee10852120e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.168095 Sep 24 03:34:43.913823 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 328/647] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:43 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:44.116392 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-7acc66f3-120f-48c1-90c0-c90dfe2b2546 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:44.116996 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-7acc66f3-120f-48c1-90c0-c90dfe2b2546 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:44.122667 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7acc66f3-120f-48c1-90c0-c90dfe2b2546 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:44.123102 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7acc66f3-120f-48c1-90c0-c90dfe2b2546 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:44.123864 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7acc66f3-120f-48c1-90c0-c90dfe2b2546 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:44.124284 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7acc66f3-120f-48c1-90c0-c90dfe2b2546 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:44.263449 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-7acc66f3-120f-48c1-90c0-c90dfe2b2546 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:44.272702 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-7acc66f3-120f-48c1-90c0-c90dfe2b2546 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1507 microversion: 2.1 time: 0.160053 Sep 24 03:34:44.273291 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 320/648] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:44 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:44.936296 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d87e5c1d-a28e-4748-8352-34040bee0007 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:44.936979 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d87e5c1d-a28e-4748-8352-34040bee0007 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:44.944735 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d87e5c1d-a28e-4748-8352-34040bee0007 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:44.945178 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d87e5c1d-a28e-4748-8352-34040bee0007 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:44.946040 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d87e5c1d-a28e-4748-8352-34040bee0007 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:44.946469 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d87e5c1d-a28e-4748-8352-34040bee0007 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:45.081264 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d87e5c1d-a28e-4748-8352-34040bee0007 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:45.090803 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d87e5c1d-a28e-4748-8352-34040bee0007 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:45.092645 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d87e5c1d-a28e-4748-8352-34040bee0007 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:45.094727 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d87e5c1d-a28e-4748-8352-34040bee0007 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.161481 Sep 24 03:34:45.095587 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 329/649] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:44 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:45.251268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 03:34:45.251509 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: Fri Sep 24 03:34:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 24 03:34:45.289859 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d6859d28-5b4b-4b83-be70-f8ccddf94a8a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:45.290476 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d6859d28-5b4b-4b83-be70-f8ccddf94a8a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:45.296623 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d6859d28-5b4b-4b83-be70-f8ccddf94a8a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:45.297574 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d6859d28-5b4b-4b83-be70-f8ccddf94a8a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:45.298161 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d6859d28-5b4b-4b83-be70-f8ccddf94a8a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:45.298588 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d6859d28-5b4b-4b83-be70-f8ccddf94a8a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:45.434699 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d6859d28-5b4b-4b83-be70-f8ccddf94a8a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:45.442404 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d6859d28-5b4b-4b83-be70-f8ccddf94a8a tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1507 microversion: 2.1 time: 0.156355 Sep 24 03:34:45.442918 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 321/650] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:45 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:46.113984 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-963dc00a-14b7-4c9a-a466-c64747b29e68 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:46.120807 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-963dc00a-14b7-4c9a-a466-c64747b29e68 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:46.128211 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-963dc00a-14b7-4c9a-a466-c64747b29e68 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:46.128738 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-963dc00a-14b7-4c9a-a466-c64747b29e68 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:46.129605 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-963dc00a-14b7-4c9a-a466-c64747b29e68 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:46.130139 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-963dc00a-14b7-4c9a-a466-c64747b29e68 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:46.386817 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-963dc00a-14b7-4c9a-a466-c64747b29e68 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:46.401800 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-963dc00a-14b7-4c9a-a466-c64747b29e68 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:46.403557 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-963dc00a-14b7-4c9a-a466-c64747b29e68 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:46.406444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-963dc00a-14b7-4c9a-a466-c64747b29e68 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.297818 Sep 24 03:34:46.408711 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 330/651] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:46 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:46.417619 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-06a63d12-35d3-4e06-bf95-13cd75ebe3ec req-5c704508-0c35-4adc-aa52-63d1b9fadbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77091753-37d0-4ee1-9824-464b2bd4a70d", "name": "network-vif-deleted", "tag": "2d1003e4-1b5a-4b64-a7bf-91ade75c29e4"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:46.419799 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:46.419799 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:34:46.428348 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-06a63d12-35d3-4e06-bf95-13cd75ebe3ec req-5c704508-0c35-4adc-aa52-63d1b9fadbd7 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:46.428686 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-06a63d12-35d3-4e06-bf95-13cd75ebe3ec req-5c704508-0c35-4adc-aa52-63d1b9fadbd7 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:46.442301 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-06a63d12-35d3-4e06-bf95-13cd75ebe3ec req-5c704508-0c35-4adc-aa52-63d1b9fadbd7 service nova] Creating event network-vif-deleted:2d1003e4-1b5a-4b64-a7bf-91ade75c29e4 for instance 77091753-37d0-4ee1-9824-464b2bd4a70d on hv-cinder-81080 Sep 24 03:34:46.448808 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-06a63d12-35d3-4e06-bf95-13cd75ebe3ec req-5c704508-0c35-4adc-aa52-63d1b9fadbd7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034466 Sep 24 03:34:46.450056 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 322/652] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:34:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:46.463205 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-bd9a076e-f6ed-40e4-8961-66313a015499 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:46.470711 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-bd9a076e-f6ed-40e4-8961-66313a015499 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:46.477259 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bd9a076e-f6ed-40e4-8961-66313a015499 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:46.478053 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bd9a076e-f6ed-40e4-8961-66313a015499 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:46.478833 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bd9a076e-f6ed-40e4-8961-66313a015499 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:46.479290 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bd9a076e-f6ed-40e4-8961-66313a015499 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:46.566004 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-bd9a076e-f6ed-40e4-8961-66313a015499 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:46.574221 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-bd9a076e-f6ed-40e4-8961-66313a015499 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 200 len: 1293 microversion: 2.1 time: 0.117809 Sep 24 03:34:46.574963 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 331/653] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:46 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 1293 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:47.427705 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-852ae318-b78a-4527-9795-ff8a41da234e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:47.428677 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-852ae318-b78a-4527-9795-ff8a41da234e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:47.434910 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-852ae318-b78a-4527-9795-ff8a41da234e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:47.435350 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-852ae318-b78a-4527-9795-ff8a41da234e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:47.436119 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-852ae318-b78a-4527-9795-ff8a41da234e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:47.436541 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-852ae318-b78a-4527-9795-ff8a41da234e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:47.572423 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-852ae318-b78a-4527-9795-ff8a41da234e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:47.581115 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-852ae318-b78a-4527-9795-ff8a41da234e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:47.582725 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-852ae318-b78a-4527-9795-ff8a41da234e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:47.584065 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-852ae318-b78a-4527-9795-ff8a41da234e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.160561 Sep 24 03:34:47.584711 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 323/654] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:47 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:34:47.598299 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a4ae6d76-a120-434b-9981-61836a38a270 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:47.598900 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a4ae6d76-a120-434b-9981-61836a38a270 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 77091753-37d0-4ee1-9824-464b2bd4a70d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:47.604873 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a4ae6d76-a120-434b-9981-61836a38a270 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:47.605312 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a4ae6d76-a120-434b-9981-61836a38a270 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:47.606291 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a4ae6d76-a120-434b-9981-61836a38a270 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:47.606873 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a4ae6d76-a120-434b-9981-61836a38a270 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:47.621671 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-a4ae6d76-a120-434b-9981-61836a38a270 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] HTTP exception thrown: Instance 77091753-37d0-4ee1-9824-464b2bd4a70d could not be found. Sep 24 03:34:47.622284 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a4ae6d76-a120-434b-9981-61836a38a270 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Returning 404 to user: Instance 77091753-37d0-4ee1-9824-464b2bd4a70d could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:34:47.623224 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a4ae6d76-a120-434b-9981-61836a38a270 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d" status: 404 len: 111 microversion: 2.1 time: 0.034878 Sep 24 03:34:47.626705 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 332/655] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:47 2021] GET /compute/v2.1/servers/77091753-37d0-4ee1-9824-464b2bd4a70d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:34:47.633089 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e4cc8e0b-f77e-4fe8-ab55-59d087c6bb74 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:47.633582 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e4cc8e0b-f77e-4fe8-ab55-59d087c6bb74 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:47.644492 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e4cc8e0b-f77e-4fe8-ab55-59d087c6bb74 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:47.644965 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e4cc8e0b-f77e-4fe8-ab55-59d087c6bb74 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:47.645771 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e4cc8e0b-f77e-4fe8-ab55-59d087c6bb74 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:47.646194 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e4cc8e0b-f77e-4fe8-ab55-59d087c6bb74 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:47.676531 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e4cc8e0b-f77e-4fe8-ab55-59d087c6bb74 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Going to try to terminate instance {{(pid=109375) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:34:47.759039 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e4cc8e0b-f77e-4fe8-ab55-59d087c6bb74 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "DELETE /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 204 len: 0 microversion: 2.1 time: 0.128589 Sep 24 03:34:47.759991 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 324/656] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:34:47 2021] DELETE /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:34:47.770252 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a4a55b4a-2049-4ca5-a8a5-a146c3679209 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:47.770962 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a4a55b4a-2049-4ca5-a8a5-a146c3679209 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:47.776740 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a4a55b4a-2049-4ca5-a8a5-a146c3679209 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:47.777245 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a4a55b4a-2049-4ca5-a8a5-a146c3679209 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:47.778116 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a4a55b4a-2049-4ca5-a8a5-a146c3679209 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:47.778613 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a4a55b4a-2049-4ca5-a8a5-a146c3679209 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:47.904802 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a4a55b4a-2049-4ca5-a8a5-a146c3679209 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:47.910812 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a4a55b4a-2049-4ca5-a8a5-a146c3679209 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.146421 Sep 24 03:34:47.911391 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 333/657] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:47 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:48.604723 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-862c7e23-6c08-4874-b371-1630fada9b46 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:48.605423 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-862c7e23-6c08-4874-b371-1630fada9b46 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:48.612012 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-862c7e23-6c08-4874-b371-1630fada9b46 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:48.612450 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-862c7e23-6c08-4874-b371-1630fada9b46 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:48.613493 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-862c7e23-6c08-4874-b371-1630fada9b46 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:48.614073 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-862c7e23-6c08-4874-b371-1630fada9b46 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:48.755770 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-862c7e23-6c08-4874-b371-1630fada9b46 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:48.763906 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-862c7e23-6c08-4874-b371-1630fada9b46 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:48.765381 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-862c7e23-6c08-4874-b371-1630fada9b46 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:48.766593 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-862c7e23-6c08-4874-b371-1630fada9b46 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.166361 Sep 24 03:34:48.767144 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 325/658] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:48 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:48.927835 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4dbde86e-d4ca-43e1-ae65-d8de67ef88e9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:48.928435 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4dbde86e-d4ca-43e1-ae65-d8de67ef88e9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:48.934281 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4dbde86e-d4ca-43e1-ae65-d8de67ef88e9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:48.934726 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4dbde86e-d4ca-43e1-ae65-d8de67ef88e9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:48.935487 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4dbde86e-d4ca-43e1-ae65-d8de67ef88e9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:48.935912 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4dbde86e-d4ca-43e1-ae65-d8de67ef88e9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:49.061172 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4dbde86e-d4ca-43e1-ae65-d8de67ef88e9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:49.068610 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4dbde86e-d4ca-43e1-ae65-d8de67ef88e9 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.144503 Sep 24 03:34:49.069220 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 334/659] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:48 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:49.202392 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-ada765fa-a259-4265-9e09-22846a163c16 req-7d2c3b3d-7fb0-407e-8fa6-a92eb499f946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f043b14-af6f-4d95-a094-87fa6c768493", "name": "network-vif-plugged", "status": "completed", "tag": "67582d29-a79f-4ee2-8844-18b26e15268b"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:49.203898 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:49.203898 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:34:49.210622 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-ada765fa-a259-4265-9e09-22846a163c16 req-7d2c3b3d-7fb0-407e-8fa6-a92eb499f946 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:49.211091 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-ada765fa-a259-4265-9e09-22846a163c16 req-7d2c3b3d-7fb0-407e-8fa6-a92eb499f946 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:49.222844 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-ada765fa-a259-4265-9e09-22846a163c16 req-7d2c3b3d-7fb0-407e-8fa6-a92eb499f946 service nova] Creating event network-vif-plugged:67582d29-a79f-4ee2-8844-18b26e15268b for instance 3f043b14-af6f-4d95-a094-87fa6c768493 on hv-cinder-81080 Sep 24 03:34:49.228071 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-ada765fa-a259-4265-9e09-22846a163c16 req-7d2c3b3d-7fb0-407e-8fa6-a92eb499f946 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029262 Sep 24 03:34:49.228971 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 326/660] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:34:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:49.786066 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7e4141aa-bba4-4ccb-aef7-aa4a646834dc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:49.786668 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-7e4141aa-bba4-4ccb-aef7-aa4a646834dc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:49.792358 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7e4141aa-bba4-4ccb-aef7-aa4a646834dc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:49.792800 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7e4141aa-bba4-4ccb-aef7-aa4a646834dc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:49.793565 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7e4141aa-bba4-4ccb-aef7-aa4a646834dc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:49.794016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7e4141aa-bba4-4ccb-aef7-aa4a646834dc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:49.917549 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7e4141aa-bba4-4ccb-aef7-aa4a646834dc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:49.925974 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7e4141aa-bba4-4ccb-aef7-aa4a646834dc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:49.927455 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7e4141aa-bba4-4ccb-aef7-aa4a646834dc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:49.928598 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7e4141aa-bba4-4ccb-aef7-aa4a646834dc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.146864 Sep 24 03:34:49.929154 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 335/661] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:49 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:50.086792 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d54b032b-c354-4065-a8a3-c2cd26c308e3 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:50.087485 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d54b032b-c354-4065-a8a3-c2cd26c308e3 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:50.093520 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d54b032b-c354-4065-a8a3-c2cd26c308e3 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:50.094059 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d54b032b-c354-4065-a8a3-c2cd26c308e3 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:50.094826 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d54b032b-c354-4065-a8a3-c2cd26c308e3 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:50.095256 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d54b032b-c354-4065-a8a3-c2cd26c308e3 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:50.214922 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d54b032b-c354-4065-a8a3-c2cd26c308e3 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:50.222594 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d54b032b-c354-4065-a8a3-c2cd26c308e3 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.139861 Sep 24 03:34:50.223169 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 327/662] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:50 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:50.946771 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-eca39dd8-513e-4196-b542-e99999a5c231 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:50.947379 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-eca39dd8-513e-4196-b542-e99999a5c231 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:50.953301 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-eca39dd8-513e-4196-b542-e99999a5c231 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:50.953695 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-eca39dd8-513e-4196-b542-e99999a5c231 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:50.954486 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-eca39dd8-513e-4196-b542-e99999a5c231 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:50.954917 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-eca39dd8-513e-4196-b542-e99999a5c231 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:51.073037 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-eca39dd8-513e-4196-b542-e99999a5c231 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:51.081392 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-eca39dd8-513e-4196-b542-e99999a5c231 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:51.082911 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-eca39dd8-513e-4196-b542-e99999a5c231 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:51.084049 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-eca39dd8-513e-4196-b542-e99999a5c231 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.140994 Sep 24 03:34:51.084633 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 336/663] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:50 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:51.240678 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-0c6f9b38-ea50-4947-87dc-5991b1684e27 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:51.241251 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-0c6f9b38-ea50-4947-87dc-5991b1684e27 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:51.247161 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0c6f9b38-ea50-4947-87dc-5991b1684e27 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:51.247593 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0c6f9b38-ea50-4947-87dc-5991b1684e27 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:51.248343 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0c6f9b38-ea50-4947-87dc-5991b1684e27 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:51.248760 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0c6f9b38-ea50-4947-87dc-5991b1684e27 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:51.369433 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-0c6f9b38-ea50-4947-87dc-5991b1684e27 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:51.376713 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-0c6f9b38-ea50-4947-87dc-5991b1684e27 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.141558 Sep 24 03:34:51.377276 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 328/664] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:51 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:52.101812 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a10d9bd3-25bc-4631-a688-4680c8ac62c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:52.102406 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a10d9bd3-25bc-4631-a688-4680c8ac62c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:52.108300 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a10d9bd3-25bc-4631-a688-4680c8ac62c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:52.108738 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a10d9bd3-25bc-4631-a688-4680c8ac62c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:52.109489 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a10d9bd3-25bc-4631-a688-4680c8ac62c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:52.109977 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a10d9bd3-25bc-4631-a688-4680c8ac62c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:52.229569 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a10d9bd3-25bc-4631-a688-4680c8ac62c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:52.238869 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a10d9bd3-25bc-4631-a688-4680c8ac62c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:52.240358 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a10d9bd3-25bc-4631-a688-4680c8ac62c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:52.241535 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a10d9bd3-25bc-4631-a688-4680c8ac62c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.143413 Sep 24 03:34:52.242113 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 337/665] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:52 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:52.393518 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9bbab40b-18bb-4133-851a-f0cff169ec31 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:52.394141 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9bbab40b-18bb-4133-851a-f0cff169ec31 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:52.400113 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9bbab40b-18bb-4133-851a-f0cff169ec31 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:52.400552 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9bbab40b-18bb-4133-851a-f0cff169ec31 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:52.401332 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9bbab40b-18bb-4133-851a-f0cff169ec31 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:52.401766 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9bbab40b-18bb-4133-851a-f0cff169ec31 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:52.520376 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-9bbab40b-18bb-4133-851a-f0cff169ec31 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:52.527775 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9bbab40b-18bb-4133-851a-f0cff169ec31 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.138280 Sep 24 03:34:52.528538 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 329/666] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:52 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:52.902862 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f98902a9-595f-4559-9339-234f4642b5f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:52.903348 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f98902a9-595f-4559-9339-234f4642b5f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:52.909884 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f98902a9-595f-4559-9339-234f4642b5f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:52.910260 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f98902a9-595f-4559-9339-234f4642b5f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:52.911022 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f98902a9-595f-4559-9339-234f4642b5f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:52.911446 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f98902a9-595f-4559-9339-234f4642b5f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:53.003806 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.objects.instance [None req-f98902a9-595f-4559-9339-234f4642b5f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lazy-loading 'services' on Instance uuid 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe {{(pid=109374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:34:53.068919 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f98902a9-595f-4559-9339-234f4642b5f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/os-volume_attachments/e0a3b693-528d-4c45-b1b7-278ee403cdb3" status: 202 len: 0 microversion: 2.1 time: 0.169620 Sep 24 03:34:53.069526 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 338/667] 10.222.0.18 () {58 vars in 1416 bytes} [Fri Sep 24 03:34:52 2021] DELETE /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/os-volume_attachments/e0a3b693-528d-4c45-b1b7-278ee403cdb3 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:34:53.260962 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6757937e-1f89-421f-ba3e-5754d7104bbf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:53.261560 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6757937e-1f89-421f-ba3e-5754d7104bbf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:53.267336 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6757937e-1f89-421f-ba3e-5754d7104bbf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:53.267781 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6757937e-1f89-421f-ba3e-5754d7104bbf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:53.269066 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6757937e-1f89-421f-ba3e-5754d7104bbf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:53.269474 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6757937e-1f89-421f-ba3e-5754d7104bbf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:53.390828 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6757937e-1f89-421f-ba3e-5754d7104bbf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:53.399758 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6757937e-1f89-421f-ba3e-5754d7104bbf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:53.401244 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6757937e-1f89-421f-ba3e-5754d7104bbf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:53.402456 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6757937e-1f89-421f-ba3e-5754d7104bbf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.145184 Sep 24 03:34:53.403009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 330/668] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:53 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:34:53.544366 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-972fc0bb-8422-4d95-8f27-a53983741038 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:53.545057 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-972fc0bb-8422-4d95-8f27-a53983741038 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:53.551819 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-972fc0bb-8422-4d95-8f27-a53983741038 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:53.552267 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-972fc0bb-8422-4d95-8f27-a53983741038 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:53.553027 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-972fc0bb-8422-4d95-8f27-a53983741038 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:53.553448 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-972fc0bb-8422-4d95-8f27-a53983741038 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:53.699906 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-972fc0bb-8422-4d95-8f27-a53983741038 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:53.708832 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-972fc0bb-8422-4d95-8f27-a53983741038 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.168234 Sep 24 03:34:53.709565 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 339/669] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:53 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:54.187588 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-7026b3e2-0972-4b52-8255-5380a6d00a03 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:54.193557 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7026b3e2-0972-4b52-8255-5380a6d00a03 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:54.194044 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7026b3e2-0972-4b52-8255-5380a6d00a03 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:54.217318 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-7026b3e2-0972-4b52-8255-5380a6d00a03 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Going to try to stop instance {{(pid=109375) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Sep 24 03:34:54.262996 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-7026b3e2-0972-4b52-8255-5380a6d00a03 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 202 len: 0 microversion: 2.1 time: 0.079422 Sep 24 03:34:54.263666 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 331/670] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:34:54 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:34:54.272793 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-32ab7e05-bd1d-429e-8132-e370d068f569 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:54.273639 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-32ab7e05-bd1d-429e-8132-e370d068f569 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:54.279920 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-32ab7e05-bd1d-429e-8132-e370d068f569 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:54.280587 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-32ab7e05-bd1d-429e-8132-e370d068f569 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:54.281350 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-32ab7e05-bd1d-429e-8132-e370d068f569 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:54.281876 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-32ab7e05-bd1d-429e-8132-e370d068f569 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:54.419046 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-32ab7e05-bd1d-429e-8132-e370d068f569 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:54.420768 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5586e09a-3e7f-47a2-bc98-e0ae7bb67943 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:54.421458 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5586e09a-3e7f-47a2-bc98-e0ae7bb67943 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:54.428091 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-32ab7e05-bd1d-429e-8132-e370d068f569 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1675 microversion: 2.1 time: 0.159986 Sep 24 03:34:54.428674 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 340/671] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:54 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:54.428852 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5586e09a-3e7f-47a2-bc98-e0ae7bb67943 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:54.429364 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5586e09a-3e7f-47a2-bc98-e0ae7bb67943 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:54.430238 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5586e09a-3e7f-47a2-bc98-e0ae7bb67943 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:54.430729 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5586e09a-3e7f-47a2-bc98-e0ae7bb67943 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:54.558452 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5586e09a-3e7f-47a2-bc98-e0ae7bb67943 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:54.567024 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5586e09a-3e7f-47a2-bc98-e0ae7bb67943 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:54.568377 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5586e09a-3e7f-47a2-bc98-e0ae7bb67943 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:54.569679 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5586e09a-3e7f-47a2-bc98-e0ae7bb67943 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1805 microversion: 2.20 time: 0.152942 Sep 24 03:34:54.570273 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 332/672] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:54 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:34:54.727103 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c91cca0e-fda2-4d4d-b119-fad63ace44d6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:54.727759 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c91cca0e-fda2-4d4d-b119-fad63ace44d6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:54.733923 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c91cca0e-fda2-4d4d-b119-fad63ace44d6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:54.734633 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c91cca0e-fda2-4d4d-b119-fad63ace44d6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:54.735642 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c91cca0e-fda2-4d4d-b119-fad63ace44d6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:54.736146 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c91cca0e-fda2-4d4d-b119-fad63ace44d6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:54.861046 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c91cca0e-fda2-4d4d-b119-fad63ace44d6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:54.869428 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c91cca0e-fda2-4d4d-b119-fad63ace44d6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.147462 Sep 24 03:34:54.870394 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 341/673] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:54 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:55.445741 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-fd036f2e-a50b-4c01-a4a8-0e41d9151d84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:55.446272 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-fd036f2e-a50b-4c01-a4a8-0e41d9151d84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:55.452194 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fd036f2e-a50b-4c01-a4a8-0e41d9151d84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:55.452636 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fd036f2e-a50b-4c01-a4a8-0e41d9151d84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:55.453396 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fd036f2e-a50b-4c01-a4a8-0e41d9151d84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:55.453859 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fd036f2e-a50b-4c01-a4a8-0e41d9151d84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:55.575252 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-fd036f2e-a50b-4c01-a4a8-0e41d9151d84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:55.582998 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-fd036f2e-a50b-4c01-a4a8-0e41d9151d84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1675 microversion: 2.1 time: 0.140958 Sep 24 03:34:55.583563 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 333/674] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:55 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:55.587800 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4df8e710-5f31-4f32-8ad8-524028f3f8b5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:55.588417 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4df8e710-5f31-4f32-8ad8-524028f3f8b5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:55.594329 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4df8e710-5f31-4f32-8ad8-524028f3f8b5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:55.595621 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4df8e710-5f31-4f32-8ad8-524028f3f8b5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:55.597000 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4df8e710-5f31-4f32-8ad8-524028f3f8b5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:55.597443 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4df8e710-5f31-4f32-8ad8-524028f3f8b5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:55.719925 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4df8e710-5f31-4f32-8ad8-524028f3f8b5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:55.728764 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4df8e710-5f31-4f32-8ad8-524028f3f8b5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:55.730303 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4df8e710-5f31-4f32-8ad8-524028f3f8b5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:55.731464 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4df8e710-5f31-4f32-8ad8-524028f3f8b5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1792 microversion: 2.20 time: 0.147420 Sep 24 03:34:55.732030 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 342/675] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:34:55 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1792 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:34:55.886902 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-debd8383-a0f5-43d5-bcac-66d2c674e1b0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:55.887501 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-debd8383-a0f5-43d5-bcac-66d2c674e1b0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:55.893156 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-debd8383-a0f5-43d5-bcac-66d2c674e1b0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:55.893635 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-debd8383-a0f5-43d5-bcac-66d2c674e1b0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:55.894415 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-debd8383-a0f5-43d5-bcac-66d2c674e1b0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:55.894841 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-debd8383-a0f5-43d5-bcac-66d2c674e1b0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:56.012436 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-debd8383-a0f5-43d5-bcac-66d2c674e1b0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:56.020346 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-debd8383-a0f5-43d5-bcac-66d2c674e1b0 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.137044 Sep 24 03:34:56.020923 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 334/676] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:55 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:56.601126 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4e1b776d-ae2e-4cdd-9a8a-54ff15cbe7a9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:56.601737 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4e1b776d-ae2e-4cdd-9a8a-54ff15cbe7a9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:56.607418 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4e1b776d-ae2e-4cdd-9a8a-54ff15cbe7a9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:56.607856 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4e1b776d-ae2e-4cdd-9a8a-54ff15cbe7a9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:56.608613 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4e1b776d-ae2e-4cdd-9a8a-54ff15cbe7a9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:56.609033 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4e1b776d-ae2e-4cdd-9a8a-54ff15cbe7a9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:56.731295 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4e1b776d-ae2e-4cdd-9a8a-54ff15cbe7a9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:56.740096 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4e1b776d-ae2e-4cdd-9a8a-54ff15cbe7a9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1675 microversion: 2.1 time: 0.142496 Sep 24 03:34:56.740854 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 343/677] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:56 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1675 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:57.036909 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e0ecbc2d-6753-48cd-bbf3-127dc25468d8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:57.037531 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e0ecbc2d-6753-48cd-bbf3-127dc25468d8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:57.043245 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e0ecbc2d-6753-48cd-bbf3-127dc25468d8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:57.043682 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e0ecbc2d-6753-48cd-bbf3-127dc25468d8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:57.044441 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e0ecbc2d-6753-48cd-bbf3-127dc25468d8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:57.044858 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e0ecbc2d-6753-48cd-bbf3-127dc25468d8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:57.170223 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e0ecbc2d-6753-48cd-bbf3-127dc25468d8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:57.178281 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e0ecbc2d-6753-48cd-bbf3-127dc25468d8 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.145445 Sep 24 03:34:57.178892 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 335/678] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:57 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:57.757796 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-bb0e91a8-7df8-4ca9-a42f-35e1c9dfaf5a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:57.758480 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-bb0e91a8-7df8-4ca9-a42f-35e1c9dfaf5a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:57.765473 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bb0e91a8-7df8-4ca9-a42f-35e1c9dfaf5a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:57.765947 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bb0e91a8-7df8-4ca9-a42f-35e1c9dfaf5a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:57.766761 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bb0e91a8-7df8-4ca9-a42f-35e1c9dfaf5a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:57.767192 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bb0e91a8-7df8-4ca9-a42f-35e1c9dfaf5a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:58.195196 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f64e4d53-408e-416c-8137-5013bd2b15b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:58.195196 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f64e4d53-408e-416c-8137-5013bd2b15b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:58.201094 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f64e4d53-408e-416c-8137-5013bd2b15b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:58.201544 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f64e4d53-408e-416c-8137-5013bd2b15b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:58.202345 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f64e4d53-408e-416c-8137-5013bd2b15b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:58.202781 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f64e4d53-408e-416c-8137-5013bd2b15b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:58.208772 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-bb0e91a8-7df8-4ca9-a42f-35e1c9dfaf5a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:58.216289 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-bb0e91a8-7df8-4ca9-a42f-35e1c9dfaf5a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1675 microversion: 2.1 time: 0.463359 Sep 24 03:34:58.216877 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 344/679] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:57 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1675 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:34:58.430804 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-f64e4d53-408e-416c-8137-5013bd2b15b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:58.438256 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f64e4d53-408e-416c-8137-5013bd2b15b6 tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1521 microversion: 2.1 time: 0.247863 Sep 24 03:34:58.438831 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 336/680] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:58 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:58.646395 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-d8804943-47db-4ca7-a07d-73fd5fa71180 req-6fc2d331-f4db-4871-8a2d-fc55a5c42ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161dd8ef-7ba0-4e37-aaf5-0c0a54dca798", "name": "network-vif-deleted", "tag": "515ade53-cef9-43f6-8ae2-c5e8d29c22f8"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:34:58.648036 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:34:58.648036 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:34:58.654829 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-d8804943-47db-4ca7-a07d-73fd5fa71180 req-6fc2d331-f4db-4871-8a2d-fc55a5c42ec1 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:58.655257 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-d8804943-47db-4ca7-a07d-73fd5fa71180 req-6fc2d331-f4db-4871-8a2d-fc55a5c42ec1 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:58.666563 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-d8804943-47db-4ca7-a07d-73fd5fa71180 req-6fc2d331-f4db-4871-8a2d-fc55a5c42ec1 service nova] Creating event network-vif-deleted:515ade53-cef9-43f6-8ae2-c5e8d29c22f8 for instance 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 on hv-cinder-81080 Sep 24 03:34:58.671302 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-d8804943-47db-4ca7-a07d-73fd5fa71180 req-6fc2d331-f4db-4871-8a2d-fc55a5c42ec1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028696 Sep 24 03:34:58.671876 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 345/681] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:34:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:34:59.233488 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8ab8d4d6-48f9-4216-b825-8b2d86486c53 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:59.234039 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8ab8d4d6-48f9-4216-b825-8b2d86486c53 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:59.240780 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ab8d4d6-48f9-4216-b825-8b2d86486c53 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:59.241224 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ab8d4d6-48f9-4216-b825-8b2d86486c53 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:59.242007 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ab8d4d6-48f9-4216-b825-8b2d86486c53 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:59.242439 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ab8d4d6-48f9-4216-b825-8b2d86486c53 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:59.363744 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8ab8d4d6-48f9-4216-b825-8b2d86486c53 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:59.375804 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8ab8d4d6-48f9-4216-b825-8b2d86486c53 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1675 microversion: 2.1 time: 0.141835 Sep 24 03:34:59.375804 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 337/682] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:59 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1675 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:34:59.455345 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8a911001-3643-4ce9-9114-3edcd9d5c05b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:34:59.456254 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8a911001-3643-4ce9-9114-3edcd9d5c05b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:34:59.462234 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8a911001-3643-4ce9-9114-3edcd9d5c05b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:59.462669 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8a911001-3643-4ce9-9114-3edcd9d5c05b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:59.463416 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8a911001-3643-4ce9-9114-3edcd9d5c05b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:34:59.463838 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8a911001-3643-4ce9-9114-3edcd9d5c05b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:34:59.529336 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8a911001-3643-4ce9-9114-3edcd9d5c05b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:34:59.537347 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8a911001-3643-4ce9-9114-3edcd9d5c05b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1479 microversion: 2.1 time: 0.085970 Sep 24 03:34:59.538171 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 346/683] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:34:59 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1479 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:00.390620 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a7b0c2ab-c23a-476d-b933-4ae92b3393c3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:00.391219 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a7b0c2ab-c23a-476d-b933-4ae92b3393c3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:00.397669 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a7b0c2ab-c23a-476d-b933-4ae92b3393c3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:00.398210 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a7b0c2ab-c23a-476d-b933-4ae92b3393c3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:00.398961 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a7b0c2ab-c23a-476d-b933-4ae92b3393c3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:00.399384 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a7b0c2ab-c23a-476d-b933-4ae92b3393c3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:00.519453 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a7b0c2ab-c23a-476d-b933-4ae92b3393c3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:00.526698 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a7b0c2ab-c23a-476d-b933-4ae92b3393c3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1675 microversion: 2.1 time: 0.139695 Sep 24 03:35:00.527267 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 338/684] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:00 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1675 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:00.553690 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-cf5033b1-e42f-4fc9-9e0e-ca08d42125ee tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:00.554326 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-cf5033b1-e42f-4fc9-9e0e-ca08d42125ee tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:00.560956 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cf5033b1-e42f-4fc9-9e0e-ca08d42125ee tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:00.561398 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cf5033b1-e42f-4fc9-9e0e-ca08d42125ee tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:00.562187 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cf5033b1-e42f-4fc9-9e0e-ca08d42125ee tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:00.562622 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cf5033b1-e42f-4fc9-9e0e-ca08d42125ee tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:00.621813 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-cf5033b1-e42f-4fc9-9e0e-ca08d42125ee tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:00.629740 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-cf5033b1-e42f-4fc9-9e0e-ca08d42125ee tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1306 microversion: 2.1 time: 0.080247 Sep 24 03:35:00.630306 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 347/685] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:00 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1306 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:01.543522 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-321d9498-76bd-4be7-a088-bf7de6ca7a3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:01.544126 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-321d9498-76bd-4be7-a088-bf7de6ca7a3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:01.549983 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-321d9498-76bd-4be7-a088-bf7de6ca7a3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:01.550414 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-321d9498-76bd-4be7-a088-bf7de6ca7a3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:01.551165 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-321d9498-76bd-4be7-a088-bf7de6ca7a3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:01.551585 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-321d9498-76bd-4be7-a088-bf7de6ca7a3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:01.646919 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-60b3dc91-c96a-463b-a472-cde2f531aafa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:01.647521 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-60b3dc91-c96a-463b-a472-cde2f531aafa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:01.653169 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60b3dc91-c96a-463b-a472-cde2f531aafa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:01.653610 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60b3dc91-c96a-463b-a472-cde2f531aafa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:01.654405 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60b3dc91-c96a-463b-a472-cde2f531aafa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:01.654855 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60b3dc91-c96a-463b-a472-cde2f531aafa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:01.674213 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-321d9498-76bd-4be7-a088-bf7de6ca7a3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:01.681910 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-321d9498-76bd-4be7-a088-bf7de6ca7a3c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1675 microversion: 2.1 time: 0.141957 Sep 24 03:35:01.682485 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 339/686] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:01 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1675 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:01.689014 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60b3dc91-c96a-463b-a472-cde2f531aafa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:01.689456 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-60b3dc91-c96a-463b-a472-cde2f531aafa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:01.690549 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.objects.instance [None req-60b3dc91-c96a-463b-a472-cde2f531aafa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lazy-loading 'fault' on Instance uuid 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 {{(pid=109374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:35:01.730470 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-60b3dc91-c96a-463b-a472-cde2f531aafa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b607477a72074dcf866931a7f6e1944e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044a5eb528040b1804ebe0176b04bcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:01.739484 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-60b3dc91-c96a-463b-a472-cde2f531aafa tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 200 len: 1311 microversion: 2.1 time: 0.097002 Sep 24 03:35:01.739974 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 348/687] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:01 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:35:02.699274 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e2834743-cb77-4c69-a781-3a090e6fca60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:02.699876 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e2834743-cb77-4c69-a781-3a090e6fca60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:02.705744 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e2834743-cb77-4c69-a781-3a090e6fca60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:02.706183 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e2834743-cb77-4c69-a781-3a090e6fca60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:02.706944 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e2834743-cb77-4c69-a781-3a090e6fca60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:02.707373 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e2834743-cb77-4c69-a781-3a090e6fca60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:02.757434 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-17babc0d-e57e-4abe-aa1f-caa33922e94b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:02.758061 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-17babc0d-e57e-4abe-aa1f-caa33922e94b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] [instance: 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:02.763835 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-17babc0d-e57e-4abe-aa1f-caa33922e94b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:02.764274 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-17babc0d-e57e-4abe-aa1f-caa33922e94b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:02.765037 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-17babc0d-e57e-4abe-aa1f-caa33922e94b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:02.765463 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-17babc0d-e57e-4abe-aa1f-caa33922e94b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:02.779765 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-17babc0d-e57e-4abe-aa1f-caa33922e94b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] HTTP exception thrown: Instance 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 could not be found. Sep 24 03:35:02.780376 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-17babc0d-e57e-4abe-aa1f-caa33922e94b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] Returning 404 to user: Instance 161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:35:02.781223 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-17babc0d-e57e-4abe-aa1f-caa33922e94b tempest-ServerRescueNegativeTestJSON-65518612 tempest-ServerRescueNegativeTestJSON-65518612-project] 10.222.0.18 "GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798" status: 404 len: 111 microversion: 2.1 time: 0.028758 Sep 24 03:35:02.781794 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 349/688] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:02 2021] GET /compute/v2.1/servers/161dd8ef-7ba0-4e37-aaf5-0c0a54dca798 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 03:35:02.828529 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e2834743-cb77-4c69-a781-3a090e6fca60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:02.836097 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e2834743-cb77-4c69-a781-3a090e6fca60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1675 microversion: 2.1 time: 0.140527 Sep 24 03:35:02.836670 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 340/689] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:02 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:03.852508 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2f2b9b5f-89f2-4650-b0f3-c053d6f1aa5b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:03.853693 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2f2b9b5f-89f2-4650-b0f3-c053d6f1aa5b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:03.861398 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f2b9b5f-89f2-4650-b0f3-c053d6f1aa5b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:03.864444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f2b9b5f-89f2-4650-b0f3-c053d6f1aa5b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:03.866676 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f2b9b5f-89f2-4650-b0f3-c053d6f1aa5b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:03.867740 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f2b9b5f-89f2-4650-b0f3-c053d6f1aa5b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:04.078516 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2f2b9b5f-89f2-4650-b0f3-c053d6f1aa5b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:04.087733 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2f2b9b5f-89f2-4650-b0f3-c053d6f1aa5b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1675 microversion: 2.1 time: 0.238664 Sep 24 03:35:04.088625 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 350/690] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:03 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:05.109972 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-4ccbf1f5-5bb7-47c8-9a5e-5c58d099bda2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:05.110660 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-4ccbf1f5-5bb7-47c8-9a5e-5c58d099bda2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:05.129780 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4ccbf1f5-5bb7-47c8-9a5e-5c58d099bda2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:05.130232 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4ccbf1f5-5bb7-47c8-9a5e-5c58d099bda2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:05.131046 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4ccbf1f5-5bb7-47c8-9a5e-5c58d099bda2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:05.131498 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4ccbf1f5-5bb7-47c8-9a5e-5c58d099bda2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:05.465571 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4ccbf1f5-5bb7-47c8-9a5e-5c58d099bda2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:05.473458 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-4ccbf1f5-5bb7-47c8-9a5e-5c58d099bda2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1675 microversion: 2.1 time: 0.372011 Sep 24 03:35:05.474063 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 341/691] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:05 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1675 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:06.491124 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-169a9014-c721-4e22-bb8d-b0a7e969b354 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:06.492607 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-169a9014-c721-4e22-bb8d-b0a7e969b354 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:06.499303 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-169a9014-c721-4e22-bb8d-b0a7e969b354 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:06.499749 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-169a9014-c721-4e22-bb8d-b0a7e969b354 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:06.500524 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-169a9014-c721-4e22-bb8d-b0a7e969b354 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:06.501041 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-169a9014-c721-4e22-bb8d-b0a7e969b354 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:06.646522 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-169a9014-c721-4e22-bb8d-b0a7e969b354 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:06.654011 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-169a9014-c721-4e22-bb8d-b0a7e969b354 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1675 microversion: 2.1 time: 0.167434 Sep 24 03:35:06.654693 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 351/692] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:06 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:07.671618 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2ad9aa2a-b410-4629-bb01-bf3cb020a208 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:07.672214 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2ad9aa2a-b410-4629-bb01-bf3cb020a208 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:07.678404 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2ad9aa2a-b410-4629-bb01-bf3cb020a208 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:07.678832 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2ad9aa2a-b410-4629-bb01-bf3cb020a208 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:07.679604 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2ad9aa2a-b410-4629-bb01-bf3cb020a208 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:07.680053 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2ad9aa2a-b410-4629-bb01-bf3cb020a208 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:07.805162 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2ad9aa2a-b410-4629-bb01-bf3cb020a208 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:07.813468 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2ad9aa2a-b410-4629-bb01-bf3cb020a208 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1675 microversion: 2.1 time: 0.145550 Sep 24 03:35:07.814073 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 342/693] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:07 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:08.830191 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9a222cff-7195-44f0-ac2f-978908bbec7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:08.830949 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9a222cff-7195-44f0-ac2f-978908bbec7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:08.836671 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9a222cff-7195-44f0-ac2f-978908bbec7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:08.837115 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9a222cff-7195-44f0-ac2f-978908bbec7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:08.837897 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9a222cff-7195-44f0-ac2f-978908bbec7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:08.838323 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9a222cff-7195-44f0-ac2f-978908bbec7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:08.993530 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-9a222cff-7195-44f0-ac2f-978908bbec7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:09.003012 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9a222cff-7195-44f0-ac2f-978908bbec7a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1675 microversion: 2.1 time: 0.175401 Sep 24 03:35:09.003917 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 352/694] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:08 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:10.022762 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-35941200-6a2b-4fa5-8b75-f1a2230796ed tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:10.023441 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-35941200-6a2b-4fa5-8b75-f1a2230796ed tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:10.029263 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-35941200-6a2b-4fa5-8b75-f1a2230796ed tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:10.029702 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-35941200-6a2b-4fa5-8b75-f1a2230796ed tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:10.030489 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-35941200-6a2b-4fa5-8b75-f1a2230796ed tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:10.030912 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-35941200-6a2b-4fa5-8b75-f1a2230796ed tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:10.152802 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-35941200-6a2b-4fa5-8b75-f1a2230796ed tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:10.160642 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-35941200-6a2b-4fa5-8b75-f1a2230796ed tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1652 microversion: 2.1 time: 0.141590 Sep 24 03:35:10.161210 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 343/695] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:10 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1652 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:10.177092 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-03e92155-b045-4312-90d2-e0a1fb2f0003 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:35:10.183196 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-03e92155-b045-4312-90d2-e0a1fb2f0003 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:10.183646 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-03e92155-b045-4312-90d2-e0a1fb2f0003 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:10.206213 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-03e92155-b045-4312-90d2-e0a1fb2f0003 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Going to try to start instance {{(pid=109374) start /opt/stack/nova/nova/compute/api.py:2675}} Sep 24 03:35:10.212226 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8ac70edc-8fb1-4aef-b559-cfc2342476c2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:35:10.213536 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8ac70edc-8fb1-4aef-b559-cfc2342476c2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:10.220063 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ac70edc-8fb1-4aef-b559-cfc2342476c2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:10.220579 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ac70edc-8fb1-4aef-b559-cfc2342476c2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:10.222615 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ac70edc-8fb1-4aef-b559-cfc2342476c2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:10.223122 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8ac70edc-8fb1-4aef-b559-cfc2342476c2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:10.250931 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-03e92155-b045-4312-90d2-e0a1fb2f0003 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action" status: 202 len: 0 microversion: 2.1 time: 0.077313 Sep 24 03:35:10.251444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 353/696] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:35:10 2021] POST /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:35:10.270533 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b0656b15-224a-4a60-b9c2-13db67600834 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:10.271427 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b0656b15-224a-4a60-b9c2-13db67600834 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:10.281224 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b0656b15-224a-4a60-b9c2-13db67600834 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:10.282129 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b0656b15-224a-4a60-b9c2-13db67600834 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:10.283081 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b0656b15-224a-4a60-b9c2-13db67600834 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:10.284448 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b0656b15-224a-4a60-b9c2-13db67600834 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:10.321758 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8ac70edc-8fb1-4aef-b559-cfc2342476c2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "POST /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/action" status: 202 len: 0 microversion: 2.1 time: 0.112115 Sep 24 03:35:10.326121 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 344/697] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:35:10 2021] POST /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:35:10.338510 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5ac8f9fb-6796-40a5-b3bc-8121decfa0b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:10.339715 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5ac8f9fb-6796-40a5-b3bc-8121decfa0b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:10.357514 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5ac8f9fb-6796-40a5-b3bc-8121decfa0b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:10.359193 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5ac8f9fb-6796-40a5-b3bc-8121decfa0b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:10.360293 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5ac8f9fb-6796-40a5-b3bc-8121decfa0b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:10.361422 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5ac8f9fb-6796-40a5-b3bc-8121decfa0b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:10.511193 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b0656b15-224a-4a60-b9c2-13db67600834 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:10.520980 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b0656b15-224a-4a60-b9c2-13db67600834 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1661 microversion: 2.1 time: 0.264803 Sep 24 03:35:10.521670 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 354/698] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:10 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1661 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:35:10.684885 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5ac8f9fb-6796-40a5-b3bc-8121decfa0b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:10.693845 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5ac8f9fb-6796-40a5-b3bc-8121decfa0b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1752 microversion: 2.1 time: 0.362068 Sep 24 03:35:10.694512 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 345/699] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:10 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1752 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:11.538796 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-70b11f1f-d822-437a-a303-b5b55ae4ca8c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:11.539632 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-70b11f1f-d822-437a-a303-b5b55ae4ca8c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:11.547010 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-70b11f1f-d822-437a-a303-b5b55ae4ca8c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:11.548132 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-70b11f1f-d822-437a-a303-b5b55ae4ca8c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:11.550435 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-70b11f1f-d822-437a-a303-b5b55ae4ca8c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:11.551138 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-70b11f1f-d822-437a-a303-b5b55ae4ca8c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:11.712809 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f3f159aa-5f01-4cd8-ab41-f7853ab90459 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:11.713506 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f3f159aa-5f01-4cd8-ab41-f7853ab90459 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:11.724525 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f3f159aa-5f01-4cd8-ab41-f7853ab90459 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:11.726275 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f3f159aa-5f01-4cd8-ab41-f7853ab90459 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:11.727096 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f3f159aa-5f01-4cd8-ab41-f7853ab90459 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:11.727527 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f3f159aa-5f01-4cd8-ab41-f7853ab90459 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:11.748802 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-70b11f1f-d822-437a-a303-b5b55ae4ca8c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:11.756993 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-70b11f1f-d822-437a-a303-b5b55ae4ca8c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1661 microversion: 2.1 time: 0.222456 Sep 24 03:35:11.757569 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 355/700] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:11 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1661 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:11.894203 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-f3f159aa-5f01-4cd8-ab41-f7853ab90459 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:11.901943 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f3f159aa-5f01-4cd8-ab41-f7853ab90459 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1752 microversion: 2.1 time: 0.193498 Sep 24 03:35:11.902517 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 346/701] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:11 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1752 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:35:12.820535 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-73ff2fb2-6cc3-48a6-a40d-dc151e2b2e4a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:12.821314 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-73ff2fb2-6cc3-48a6-a40d-dc151e2b2e4a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:12.827212 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-73ff2fb2-6cc3-48a6-a40d-dc151e2b2e4a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:12.827656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-73ff2fb2-6cc3-48a6-a40d-dc151e2b2e4a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:12.828417 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-73ff2fb2-6cc3-48a6-a40d-dc151e2b2e4a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:12.828841 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-73ff2fb2-6cc3-48a6-a40d-dc151e2b2e4a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:12.921013 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-96b5f4f6-74b7-4f2b-bc29-7a45dbd62a79 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:12.922342 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-96b5f4f6-74b7-4f2b-bc29-7a45dbd62a79 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:12.937399 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-96b5f4f6-74b7-4f2b-bc29-7a45dbd62a79 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:12.938144 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-96b5f4f6-74b7-4f2b-bc29-7a45dbd62a79 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:12.939080 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-96b5f4f6-74b7-4f2b-bc29-7a45dbd62a79 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:12.940310 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-96b5f4f6-74b7-4f2b-bc29-7a45dbd62a79 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:12.983134 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-73ff2fb2-6cc3-48a6-a40d-dc151e2b2e4a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:12.991268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-73ff2fb2-6cc3-48a6-a40d-dc151e2b2e4a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1665 microversion: 2.1 time: 0.174664 Sep 24 03:35:12.994560 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 356/702] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:12 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1665 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:13.126196 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-96b5f4f6-74b7-4f2b-bc29-7a45dbd62a79 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:13.135455 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-96b5f4f6-74b7-4f2b-bc29-7a45dbd62a79 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.219159 Sep 24 03:35:13.147147 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 347/703] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:12 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:14.157217 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a7612b8a-4d53-4a10-a9fe-12a48ffb3e8a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:14.157855 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a7612b8a-4d53-4a10-a9fe-12a48ffb3e8a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:14.163966 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a7612b8a-4d53-4a10-a9fe-12a48ffb3e8a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:14.164354 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a7612b8a-4d53-4a10-a9fe-12a48ffb3e8a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:14.165125 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a7612b8a-4d53-4a10-a9fe-12a48ffb3e8a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:14.165558 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a7612b8a-4d53-4a10-a9fe-12a48ffb3e8a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:14.298188 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a7612b8a-4d53-4a10-a9fe-12a48ffb3e8a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:14.307176 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a7612b8a-4d53-4a10-a9fe-12a48ffb3e8a tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.153548 Sep 24 03:35:14.307755 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 357/704] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:14 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:15.324124 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-92c303d4-fc96-4ec9-b496-97dae6ad6be6 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:15.324752 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-92c303d4-fc96-4ec9-b496-97dae6ad6be6 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:15.330774 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92c303d4-fc96-4ec9-b496-97dae6ad6be6 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:15.331214 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92c303d4-fc96-4ec9-b496-97dae6ad6be6 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:15.331977 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92c303d4-fc96-4ec9-b496-97dae6ad6be6 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:15.332406 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92c303d4-fc96-4ec9-b496-97dae6ad6be6 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:15.452644 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-92c303d4-fc96-4ec9-b496-97dae6ad6be6 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:15.461089 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-92c303d4-fc96-4ec9-b496-97dae6ad6be6 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.140690 Sep 24 03:35:15.461657 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 348/705] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:15 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:16.477317 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-920fc7fd-e206-480f-a183-55ec1298e4d2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:16.477950 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-920fc7fd-e206-480f-a183-55ec1298e4d2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:16.483672 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-920fc7fd-e206-480f-a183-55ec1298e4d2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:16.484113 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-920fc7fd-e206-480f-a183-55ec1298e4d2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:16.484879 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-920fc7fd-e206-480f-a183-55ec1298e4d2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:16.485320 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-920fc7fd-e206-480f-a183-55ec1298e4d2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:16.621990 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-920fc7fd-e206-480f-a183-55ec1298e4d2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:16.629792 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-920fc7fd-e206-480f-a183-55ec1298e4d2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.156130 Sep 24 03:35:16.630363 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 358/706] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:16 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:17.647347 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ce91e905-3427-4ed5-a872-de0f4d256c71 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:17.647947 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ce91e905-3427-4ed5-a872-de0f4d256c71 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:17.653664 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ce91e905-3427-4ed5-a872-de0f4d256c71 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:17.654138 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ce91e905-3427-4ed5-a872-de0f4d256c71 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:17.654898 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ce91e905-3427-4ed5-a872-de0f4d256c71 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:17.655326 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ce91e905-3427-4ed5-a872-de0f4d256c71 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:17.780902 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ce91e905-3427-4ed5-a872-de0f4d256c71 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:17.789141 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ce91e905-3427-4ed5-a872-de0f4d256c71 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.146646 Sep 24 03:35:17.789738 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 349/707] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:17 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:35:18.805824 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3b18394a-51f2-4482-a3a3-75f8bb372aeb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:18.806562 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3b18394a-51f2-4482-a3a3-75f8bb372aeb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:18.812754 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3b18394a-51f2-4482-a3a3-75f8bb372aeb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:18.813218 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3b18394a-51f2-4482-a3a3-75f8bb372aeb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:18.814037 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3b18394a-51f2-4482-a3a3-75f8bb372aeb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:18.815007 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3b18394a-51f2-4482-a3a3-75f8bb372aeb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:18.949342 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3b18394a-51f2-4482-a3a3-75f8bb372aeb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:18.959247 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3b18394a-51f2-4482-a3a3-75f8bb372aeb tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.157074 Sep 24 03:35:18.960195 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 359/708] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:18 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:19.976075 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5f5a56f3-285f-4ab2-94db-03d1927411a3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:19.976661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5f5a56f3-285f-4ab2-94db-03d1927411a3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:19.982480 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5f5a56f3-285f-4ab2-94db-03d1927411a3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:19.982917 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5f5a56f3-285f-4ab2-94db-03d1927411a3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:19.983668 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5f5a56f3-285f-4ab2-94db-03d1927411a3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:19.984091 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5f5a56f3-285f-4ab2-94db-03d1927411a3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:20.105885 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5f5a56f3-285f-4ab2-94db-03d1927411a3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:20.115014 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5f5a56f3-285f-4ab2-94db-03d1927411a3 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.142530 Sep 24 03:35:20.115728 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 350/709] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:19 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:21.011843 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-792757136", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "networks": [{"uuid": "ce30542c-69af-4033-9d35-5d6651a01e27"}]}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:35:21.066119 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.network.neutron [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] validate_networks() for [('ce30542c-69af-4033-9d35-5d6651a01e27', None, None, None, None, None)] {{(pid=109374) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:35:21.131335 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3a4c7c20-eac6-46e6-99a9-506001b703dc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:21.131932 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3a4c7c20-eac6-46e6-99a9-506001b703dc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:21.138102 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3a4c7c20-eac6-46e6-99a9-506001b703dc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:21.138541 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3a4c7c20-eac6-46e6-99a9-506001b703dc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:21.139306 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3a4c7c20-eac6-46e6-99a9-506001b703dc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:21.139731 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3a4c7c20-eac6-46e6-99a9-506001b703dc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:21.333373 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-3a4c7c20-eac6-46e6-99a9-506001b703dc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:21.344406 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3a4c7c20-eac6-46e6-99a9-506001b703dc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.216754 Sep 24 03:35:21.344991 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 351/710] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:21 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:35:21.491365 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Flavor limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:35:21.491835 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Image limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:35:21.492303 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Flavor pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:35:21.492712 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Image pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:35:21.493116 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:35:21.502813 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:21.503295 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:21.504100 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:21.504529 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:21.522730 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Getting quotas for project f90f5ee150c84714b914726dff583040. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:35:21.526610 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Getting quotas for user 40ce35e824ae44ce8f1a9d3268fda85a and project f90f5ee150c84714b914726dff583040. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:35:21.538196 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Going to run 1 instances... {{(pid=109374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:35:21.540498 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:35:21.586367 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c38fc388-bd52-459e-9bfa-4c255a0fa033 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578590 Sep 24 03:35:21.587022 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 360/711] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:35:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:35:21.598522 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c5b33ad1-7bff-4b68-8916-c246b5028a5a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:21.599133 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c5b33ad1-7bff-4b68-8916-c246b5028a5a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:21.653670 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c5b33ad1-7bff-4b68-8916-c246b5028a5a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:21.662056 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c5b33ad1-7bff-4b68-8916-c246b5028a5a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 200 len: 1218 microversion: 2.1 time: 0.068570 Sep 24 03:35:21.662627 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 352/712] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:21 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:22.360441 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1a3dee51-06f2-4873-8533-e1cf7b0f29c7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:22.361051 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1a3dee51-06f2-4873-8533-e1cf7b0f29c7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:22.368228 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1a3dee51-06f2-4873-8533-e1cf7b0f29c7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:22.368671 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1a3dee51-06f2-4873-8533-e1cf7b0f29c7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:22.369517 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1a3dee51-06f2-4873-8533-e1cf7b0f29c7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:22.370015 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1a3dee51-06f2-4873-8533-e1cf7b0f29c7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:22.544275 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1a3dee51-06f2-4873-8533-e1cf7b0f29c7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:22.556575 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1a3dee51-06f2-4873-8533-e1cf7b0f29c7 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.199973 Sep 24 03:35:22.557501 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 361/713] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:22 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:22.682660 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c5eb143c-a36d-4390-9be1-977f25c4cb5d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:22.683276 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c5eb143c-a36d-4390-9be1-977f25c4cb5d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:22.690269 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c5eb143c-a36d-4390-9be1-977f25c4cb5d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:22.690372 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c5eb143c-a36d-4390-9be1-977f25c4cb5d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:22.691076 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c5eb143c-a36d-4390-9be1-977f25c4cb5d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:22.691509 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c5eb143c-a36d-4390-9be1-977f25c4cb5d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:22.770020 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c5eb143c-a36d-4390-9be1-977f25c4cb5d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:22.777907 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c5eb143c-a36d-4390-9be1-977f25c4cb5d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 200 len: 1276 microversion: 2.1 time: 0.101048 Sep 24 03:35:22.779120 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 353/714] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:22 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:23.574496 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ccb3e249-0a87-43b5-802a-c3952e74e699 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:23.575106 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ccb3e249-0a87-43b5-802a-c3952e74e699 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:23.581995 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ccb3e249-0a87-43b5-802a-c3952e74e699 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:23.582448 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ccb3e249-0a87-43b5-802a-c3952e74e699 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:23.583227 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ccb3e249-0a87-43b5-802a-c3952e74e699 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:23.583656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ccb3e249-0a87-43b5-802a-c3952e74e699 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:23.796550 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-cf7bdf08-fc99-456c-a1e5-4ecccad3601c tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:23.797200 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-cf7bdf08-fc99-456c-a1e5-4ecccad3601c tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:23.803236 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cf7bdf08-fc99-456c-a1e5-4ecccad3601c tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:23.803687 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cf7bdf08-fc99-456c-a1e5-4ecccad3601c tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:23.804465 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cf7bdf08-fc99-456c-a1e5-4ecccad3601c tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:23.804898 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cf7bdf08-fc99-456c-a1e5-4ecccad3601c tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:23.826086 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ccb3e249-0a87-43b5-802a-c3952e74e699 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:23.841266 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ccb3e249-0a87-43b5-802a-c3952e74e699 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.270242 Sep 24 03:35:23.842139 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 362/715] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:23 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:24.077212 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-13b7c44e-702e-4346-a232-29232747d2d0 req-c029f108-239d-486a-9567-82b5887a46f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b2947b8-8c83-4cef-986b-fc6f1c5d0638", "tag": "cf89626a-0edc-4473-b110-62d1dceec972"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:35:24.079097 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:35:24.079097 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:35:24.088436 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-cf7bdf08-fc99-456c-a1e5-4ecccad3601c tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:24.091143 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-13b7c44e-702e-4346-a232-29232747d2d0 req-c029f108-239d-486a-9567-82b5887a46f3 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:24.091673 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-13b7c44e-702e-4346-a232-29232747d2d0 req-c029f108-239d-486a-9567-82b5887a46f3 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:24.102982 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-cf7bdf08-fc99-456c-a1e5-4ecccad3601c tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 200 len: 1318 microversion: 2.1 time: 0.309864 Sep 24 03:35:24.104172 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 354/716] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:23 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:35:24.115352 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-13b7c44e-702e-4346-a232-29232747d2d0 req-c029f108-239d-486a-9567-82b5887a46f3 service nova] Creating event network-changed:cf89626a-0edc-4473-b110-62d1dceec972 for instance 9b2947b8-8c83-4cef-986b-fc6f1c5d0638 on hv-cinder-81080 Sep 24 03:35:24.120525 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-13b7c44e-702e-4346-a232-29232747d2d0 req-c029f108-239d-486a-9567-82b5887a46f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046820 Sep 24 03:35:24.121496 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 363/717] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:35:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:35:24.859259 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-028994d9-8749-46ed-9f8a-c6265d73c7cc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:24.859853 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-028994d9-8749-46ed-9f8a-c6265d73c7cc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:24.868082 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-028994d9-8749-46ed-9f8a-c6265d73c7cc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:24.868805 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-028994d9-8749-46ed-9f8a-c6265d73c7cc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:24.869845 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-028994d9-8749-46ed-9f8a-c6265d73c7cc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:24.870535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-028994d9-8749-46ed-9f8a-c6265d73c7cc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:25.120984 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b079bb5f-7253-4331-ad96-2bd25bf3b196 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:25.122621 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b079bb5f-7253-4331-ad96-2bd25bf3b196 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:25.129860 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b079bb5f-7253-4331-ad96-2bd25bf3b196 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:25.130493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b079bb5f-7253-4331-ad96-2bd25bf3b196 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:25.131431 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b079bb5f-7253-4331-ad96-2bd25bf3b196 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:25.132049 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b079bb5f-7253-4331-ad96-2bd25bf3b196 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:25.208558 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-028994d9-8749-46ed-9f8a-c6265d73c7cc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:25.222014 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-028994d9-8749-46ed-9f8a-c6265d73c7cc tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.365834 Sep 24 03:35:25.233187 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 355/718] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:24 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:25.412183 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b079bb5f-7253-4331-ad96-2bd25bf3b196 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:25.421326 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b079bb5f-7253-4331-ad96-2bd25bf3b196 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 200 len: 1318 microversion: 2.1 time: 0.304558 Sep 24 03:35:25.422152 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 364/719] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:25 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:35:26.240723 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c37513eb-d5c1-477f-bdfb-e2264124c96e tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:26.241326 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c37513eb-d5c1-477f-bdfb-e2264124c96e tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:26.247088 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c37513eb-d5c1-477f-bdfb-e2264124c96e tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:26.247536 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c37513eb-d5c1-477f-bdfb-e2264124c96e tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:26.248300 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c37513eb-d5c1-477f-bdfb-e2264124c96e tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:26.248728 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c37513eb-d5c1-477f-bdfb-e2264124c96e tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:26.371265 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c37513eb-d5c1-477f-bdfb-e2264124c96e tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:26.380354 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c37513eb-d5c1-477f-bdfb-e2264124c96e tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.144189 Sep 24 03:35:26.380938 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 356/720] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:26 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:26.438090 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b9723844-0d55-4db1-a7f7-f6ff1a90cb10 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:26.438662 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b9723844-0d55-4db1-a7f7-f6ff1a90cb10 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:26.445242 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b9723844-0d55-4db1-a7f7-f6ff1a90cb10 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:26.445681 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b9723844-0d55-4db1-a7f7-f6ff1a90cb10 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:26.446470 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b9723844-0d55-4db1-a7f7-f6ff1a90cb10 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:26.446891 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b9723844-0d55-4db1-a7f7-f6ff1a90cb10 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:26.584461 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b9723844-0d55-4db1-a7f7-f6ff1a90cb10 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:26.594556 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b9723844-0d55-4db1-a7f7-f6ff1a90cb10 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 200 len: 1318 microversion: 2.1 time: 0.160132 Sep 24 03:35:26.595125 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 365/721] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:26 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:27.397798 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a54452e4-96e0-4e66-8099-92731c2beb54 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:27.398405 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a54452e4-96e0-4e66-8099-92731c2beb54 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:27.404251 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a54452e4-96e0-4e66-8099-92731c2beb54 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:27.404691 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a54452e4-96e0-4e66-8099-92731c2beb54 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:27.405457 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a54452e4-96e0-4e66-8099-92731c2beb54 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:27.405914 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a54452e4-96e0-4e66-8099-92731c2beb54 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:27.563211 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a54452e4-96e0-4e66-8099-92731c2beb54 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:27.571604 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a54452e4-96e0-4e66-8099-92731c2beb54 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.177612 Sep 24 03:35:27.572177 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 357/722] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:27 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:27.611592 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7745b45e-143b-4a73-be98-2167d8c21401 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:27.612235 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-7745b45e-143b-4a73-be98-2167d8c21401 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:27.618445 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7745b45e-143b-4a73-be98-2167d8c21401 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:27.618892 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7745b45e-143b-4a73-be98-2167d8c21401 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:27.619664 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7745b45e-143b-4a73-be98-2167d8c21401 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:27.620094 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7745b45e-143b-4a73-be98-2167d8c21401 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:27.774257 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7745b45e-143b-4a73-be98-2167d8c21401 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:27.783845 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7745b45e-143b-4a73-be98-2167d8c21401 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 200 len: 1318 microversion: 2.1 time: 0.175267 Sep 24 03:35:27.784790 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 366/723] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:27 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:28.587871 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3dc5f83c-17a1-454e-9e56-d63321328063 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:28.588471 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3dc5f83c-17a1-454e-9e56-d63321328063 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:28.595485 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3dc5f83c-17a1-454e-9e56-d63321328063 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:28.599023 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3dc5f83c-17a1-454e-9e56-d63321328063 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:28.601132 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3dc5f83c-17a1-454e-9e56-d63321328063 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:28.601579 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3dc5f83c-17a1-454e-9e56-d63321328063 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:28.731867 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-3dc5f83c-17a1-454e-9e56-d63321328063 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:28.740100 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3dc5f83c-17a1-454e-9e56-d63321328063 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.155794 Sep 24 03:35:28.740668 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 358/724] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:28 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:28.799912 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-33b3cf53-80de-4a8c-a565-e353ff3c6063 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:28.800507 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-33b3cf53-80de-4a8c-a565-e353ff3c6063 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:28.806235 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-33b3cf53-80de-4a8c-a565-e353ff3c6063 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:28.806676 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-33b3cf53-80de-4a8c-a565-e353ff3c6063 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:28.807435 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-33b3cf53-80de-4a8c-a565-e353ff3c6063 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:28.807852 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-33b3cf53-80de-4a8c-a565-e353ff3c6063 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:28.934064 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-33b3cf53-80de-4a8c-a565-e353ff3c6063 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:28.949472 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-33b3cf53-80de-4a8c-a565-e353ff3c6063 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 200 len: 1318 microversion: 2.1 time: 0.152901 Sep 24 03:35:28.959452 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 367/725] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:28 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:29.759050 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a1281bb8-485c-4142-bb16-07e8b62277b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:29.759663 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a1281bb8-485c-4142-bb16-07e8b62277b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:29.766255 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a1281bb8-485c-4142-bb16-07e8b62277b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:29.766900 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a1281bb8-485c-4142-bb16-07e8b62277b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:29.767907 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a1281bb8-485c-4142-bb16-07e8b62277b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:29.768713 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a1281bb8-485c-4142-bb16-07e8b62277b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:29.912951 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-b8e77f38-00da-41ad-88d4-4791c1be4c0c req-1c7b4d18-d16c-4cdb-a00c-343077375d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2947b8-8c83-4cef-986b-fc6f1c5d0638", "name": "network-vif-plugged", "status": "completed", "tag": "cf89626a-0edc-4473-b110-62d1dceec972"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:35:29.915230 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:35:29.915230 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:35:29.922141 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-b8e77f38-00da-41ad-88d4-4791c1be4c0c req-1c7b4d18-d16c-4cdb-a00c-343077375d30 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:29.922581 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-b8e77f38-00da-41ad-88d4-4791c1be4c0c req-1c7b4d18-d16c-4cdb-a00c-343077375d30 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:29.935528 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-b8e77f38-00da-41ad-88d4-4791c1be4c0c req-1c7b4d18-d16c-4cdb-a00c-343077375d30 service nova] Creating event network-vif-plugged:cf89626a-0edc-4473-b110-62d1dceec972 for instance 9b2947b8-8c83-4cef-986b-fc6f1c5d0638 on hv-cinder-81080 Sep 24 03:35:29.941210 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-b8e77f38-00da-41ad-88d4-4791c1be4c0c req-1c7b4d18-d16c-4cdb-a00c-343077375d30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035327 Sep 24 03:35:29.942334 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 368/726] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:35:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:35:29.944725 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a1281bb8-485c-4142-bb16-07e8b62277b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:29.952867 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a1281bb8-485c-4142-bb16-07e8b62277b8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.197203 Sep 24 03:35:29.953453 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 359/727] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:29 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:35:29.971987 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-da695428-f7f1-42b9-8df4-303e18b1d7f3 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:29.972847 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-da695428-f7f1-42b9-8df4-303e18b1d7f3 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:29.979840 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-da695428-f7f1-42b9-8df4-303e18b1d7f3 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:29.980553 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-da695428-f7f1-42b9-8df4-303e18b1d7f3 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:29.981523 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-da695428-f7f1-42b9-8df4-303e18b1d7f3 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:29.982152 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-da695428-f7f1-42b9-8df4-303e18b1d7f3 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:30.113530 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-da695428-f7f1-42b9-8df4-303e18b1d7f3 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:30.120987 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-da695428-f7f1-42b9-8df4-303e18b1d7f3 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 200 len: 1318 microversion: 2.1 time: 0.153342 Sep 24 03:35:30.121578 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 369/728] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:29 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:30.969944 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-897232a1-fa82-43a8-9c6e-a44dfa3e02cf tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:30.971085 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-897232a1-fa82-43a8-9c6e-a44dfa3e02cf tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:30.984390 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-897232a1-fa82-43a8-9c6e-a44dfa3e02cf tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:30.984390 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-897232a1-fa82-43a8-9c6e-a44dfa3e02cf tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:30.984390 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-897232a1-fa82-43a8-9c6e-a44dfa3e02cf tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:30.984390 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-897232a1-fa82-43a8-9c6e-a44dfa3e02cf tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:31.109091 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-897232a1-fa82-43a8-9c6e-a44dfa3e02cf tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:31.117766 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-897232a1-fa82-43a8-9c6e-a44dfa3e02cf tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.152394 Sep 24 03:35:31.118344 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 360/729] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:30 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:31.138267 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e8a150bb-5d56-41d2-b773-540f0674148e tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:31.138868 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e8a150bb-5d56-41d2-b773-540f0674148e tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:31.145254 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8a150bb-5d56-41d2-b773-540f0674148e tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:31.145904 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8a150bb-5d56-41d2-b773-540f0674148e tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:31.147179 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8a150bb-5d56-41d2-b773-540f0674148e tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:31.147706 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8a150bb-5d56-41d2-b773-540f0674148e tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:31.277619 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e8a150bb-5d56-41d2-b773-540f0674148e tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:31.286901 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e8a150bb-5d56-41d2-b773-540f0674148e tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 200 len: 1318 microversion: 2.1 time: 0.152631 Sep 24 03:35:31.287483 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 370/730] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:31 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:32.135824 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-93b1c7eb-4e18-4d32-bb37-0504a4b11415 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:32.136870 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-93b1c7eb-4e18-4d32-bb37-0504a4b11415 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:32.145965 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-93b1c7eb-4e18-4d32-bb37-0504a4b11415 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:32.147244 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-93b1c7eb-4e18-4d32-bb37-0504a4b11415 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:32.148526 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-93b1c7eb-4e18-4d32-bb37-0504a4b11415 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:32.149330 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-93b1c7eb-4e18-4d32-bb37-0504a4b11415 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:32.283832 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-93b1c7eb-4e18-4d32-bb37-0504a4b11415 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:32.291552 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-93b1c7eb-4e18-4d32-bb37-0504a4b11415 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.160779 Sep 24 03:35:32.292117 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 361/731] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:32 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:32.303253 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e8391ef4-6a52-456c-9a80-637c4baa19ba tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:32.303848 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e8391ef4-6a52-456c-9a80-637c4baa19ba tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:32.309848 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8391ef4-6a52-456c-9a80-637c4baa19ba tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:32.310286 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8391ef4-6a52-456c-9a80-637c4baa19ba tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:32.311055 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8391ef4-6a52-456c-9a80-637c4baa19ba tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:32.311476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8391ef4-6a52-456c-9a80-637c4baa19ba tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:32.435222 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e8391ef4-6a52-456c-9a80-637c4baa19ba tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:32.444135 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e8391ef4-6a52-456c-9a80-637c4baa19ba tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 200 len: 1507 microversion: 2.1 time: 0.144485 Sep 24 03:35:32.444769 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 371/732] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:32 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 1507 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:33.308756 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b80e8b13-0adf-40e7-a054-22c09e535c9d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:33.309373 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b80e8b13-0adf-40e7-a054-22c09e535c9d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:33.315132 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b80e8b13-0adf-40e7-a054-22c09e535c9d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:33.315586 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b80e8b13-0adf-40e7-a054-22c09e535c9d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:33.316359 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b80e8b13-0adf-40e7-a054-22c09e535c9d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:33.316825 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b80e8b13-0adf-40e7-a054-22c09e535c9d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:33.464575 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b80e8b13-0adf-40e7-a054-22c09e535c9d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:33.474099 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b80e8b13-0adf-40e7-a054-22c09e535c9d tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1757 microversion: 2.1 time: 0.169136 Sep 24 03:35:33.474849 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 362/733] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:33 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:34.492340 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-49e20eb8-8063-4af4-883d-079efe06f76c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:34.492934 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-49e20eb8-8063-4af4-883d-079efe06f76c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:34.499605 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-49e20eb8-8063-4af4-883d-079efe06f76c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:34.500286 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-49e20eb8-8063-4af4-883d-079efe06f76c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:34.501331 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-49e20eb8-8063-4af4-883d-079efe06f76c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:34.502543 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-49e20eb8-8063-4af4-883d-079efe06f76c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:34.633113 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-49e20eb8-8063-4af4-883d-079efe06f76c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:34.650500 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-49e20eb8-8063-4af4-883d-079efe06f76c tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1760 microversion: 2.1 time: 0.161777 Sep 24 03:35:34.651077 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 372/734] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:34 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:35:44.320624 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1ca8b668-1df3-4761-a41a-3bf148814778 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:44.321225 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1ca8b668-1df3-4761-a41a-3bf148814778 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:44.326929 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1ca8b668-1df3-4761-a41a-3bf148814778 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:44.327369 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1ca8b668-1df3-4761-a41a-3bf148814778 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:44.328120 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1ca8b668-1df3-4761-a41a-3bf148814778 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:44.328542 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1ca8b668-1df3-4761-a41a-3bf148814778 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:44.357403 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1ca8b668-1df3-4761-a41a-3bf148814778 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/os-volume_attachments/1523763a-fbce-43de-be1e-ad1f53da6055" status: 200 len: 194 microversion: 2.20 time: 0.041111 Sep 24 03:35:44.358014 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 363/735] 10.222.0.18 () {60 vars in 1454 bytes} [Fri Sep 24 03:35:44 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/os-volume_attachments/1523763a-fbce-43de-be1e-ad1f53da6055 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:35:44.429908 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-dcc8c5a2-5165-4031-b1e5-159f34fd2292 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:44.430413 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-dcc8c5a2-5165-4031-b1e5-159f34fd2292 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:44.440052 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dcc8c5a2-5165-4031-b1e5-159f34fd2292 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:44.440052 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dcc8c5a2-5165-4031-b1e5-159f34fd2292 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:44.440052 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dcc8c5a2-5165-4031-b1e5-159f34fd2292 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:44.440052 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dcc8c5a2-5165-4031-b1e5-159f34fd2292 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:44.529425 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.objects.instance [None req-dcc8c5a2-5165-4031-b1e5-159f34fd2292 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lazy-loading 'services' on Instance uuid 3f043b14-af6f-4d95-a094-87fa6c768493 {{(pid=109374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:35:44.595755 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-dcc8c5a2-5165-4031-b1e5-159f34fd2292 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/os-volume_attachments/1523763a-fbce-43de-be1e-ad1f53da6055" status: 202 len: 0 microversion: 2.20 time: 0.170481 Sep 24 03:35:44.596348 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 373/736] 10.222.0.18 () {60 vars in 1457 bytes} [Fri Sep 24 03:35:44 2021] DELETE /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/os-volume_attachments/1523763a-fbce-43de-be1e-ad1f53da6055 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:35:44.605744 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d806cd0c-0d23-4fef-bca7-61417d53368f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:44.606752 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d806cd0c-0d23-4fef-bca7-61417d53368f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:44.612959 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d806cd0c-0d23-4fef-bca7-61417d53368f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:44.613396 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d806cd0c-0d23-4fef-bca7-61417d53368f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:44.614202 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d806cd0c-0d23-4fef-bca7-61417d53368f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:44.614624 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d806cd0c-0d23-4fef-bca7-61417d53368f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:44.644504 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d806cd0c-0d23-4fef-bca7-61417d53368f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043335 Sep 24 03:35:44.645672 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 364/737] 10.222.0.18 () {60 vars in 1343 bytes} [Fri Sep 24 03:35:44 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:35:45.657400 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-78888996-b944-4143-b0a7-7ffb96144c12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:45.658484 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-78888996-b944-4143-b0a7-7ffb96144c12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:45.665969 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-78888996-b944-4143-b0a7-7ffb96144c12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:45.666420 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-78888996-b944-4143-b0a7-7ffb96144c12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:45.667222 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-78888996-b944-4143-b0a7-7ffb96144c12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:45.667711 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-78888996-b944-4143-b0a7-7ffb96144c12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:45.707559 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-78888996-b944-4143-b0a7-7ffb96144c12 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054104 Sep 24 03:35:45.708432 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 374/738] 10.222.0.18 () {60 vars in 1343 bytes} [Fri Sep 24 03:35:45 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:45.771136 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8d45b811-09b5-4acb-80b1-e2980d0710fb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:45.771625 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8d45b811-09b5-4acb-80b1-e2980d0710fb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:45.778084 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8d45b811-09b5-4acb-80b1-e2980d0710fb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:45.778526 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8d45b811-09b5-4acb-80b1-e2980d0710fb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:45.779281 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8d45b811-09b5-4acb-80b1-e2980d0710fb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:45.779700 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8d45b811-09b5-4acb-80b1-e2980d0710fb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:45.803063 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8d45b811-09b5-4acb-80b1-e2980d0710fb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Going to try to terminate instance {{(pid=109375) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:35:45.877700 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8d45b811-09b5-4acb-80b1-e2980d0710fb tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 204 len: 0 microversion: 2.20 time: 0.109901 Sep 24 03:35:45.878334 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 365/739] 10.222.0.18 () {60 vars in 1280 bytes} [Fri Sep 24 03:35:45 2021] DELETE /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 03:35:45.888229 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-770d60b7-ccd1-4499-bdf0-3be969fdc486 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:45.888826 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-770d60b7-ccd1-4499-bdf0-3be969fdc486 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:45.895012 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-770d60b7-ccd1-4499-bdf0-3be969fdc486 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:45.895455 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-770d60b7-ccd1-4499-bdf0-3be969fdc486 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:45.896215 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-770d60b7-ccd1-4499-bdf0-3be969fdc486 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:45.896666 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-770d60b7-ccd1-4499-bdf0-3be969fdc486 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:46.025743 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-770d60b7-ccd1-4499-bdf0-3be969fdc486 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:46.033777 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-770d60b7-ccd1-4499-bdf0-3be969fdc486 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:46.035295 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-770d60b7-ccd1-4499-bdf0-3be969fdc486 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:46.036480 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-770d60b7-ccd1-4499-bdf0-3be969fdc486 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.152216 Sep 24 03:35:46.037052 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 375/740] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:35:45 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:35:47.055194 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5bdf75d6-4d26-4a7d-baec-ec7c6683955d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:47.055891 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5bdf75d6-4d26-4a7d-baec-ec7c6683955d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:47.061816 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5bdf75d6-4d26-4a7d-baec-ec7c6683955d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:47.062266 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5bdf75d6-4d26-4a7d-baec-ec7c6683955d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:47.063034 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5bdf75d6-4d26-4a7d-baec-ec7c6683955d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:47.063471 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5bdf75d6-4d26-4a7d-baec-ec7c6683955d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:47.185221 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5bdf75d6-4d26-4a7d-baec-ec7c6683955d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:47.193359 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5bdf75d6-4d26-4a7d-baec-ec7c6683955d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:47.194887 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5bdf75d6-4d26-4a7d-baec-ec7c6683955d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:47.196169 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5bdf75d6-4d26-4a7d-baec-ec7c6683955d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.145056 Sep 24 03:35:47.196735 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 366/741] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:35:47 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:35:48.215208 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b03702a0-592b-44a9-89bb-91a300aed793 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:48.215728 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b03702a0-592b-44a9-89bb-91a300aed793 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:48.221557 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b03702a0-592b-44a9-89bb-91a300aed793 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:48.222026 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b03702a0-592b-44a9-89bb-91a300aed793 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:48.222792 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b03702a0-592b-44a9-89bb-91a300aed793 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:48.223218 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b03702a0-592b-44a9-89bb-91a300aed793 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:48.451265 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b03702a0-592b-44a9-89bb-91a300aed793 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:48.460507 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b03702a0-592b-44a9-89bb-91a300aed793 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:48.463324 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b03702a0-592b-44a9-89bb-91a300aed793 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:48.464672 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b03702a0-592b-44a9-89bb-91a300aed793 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 200 len: 1720 microversion: 2.20 time: 0.254550 Sep 24 03:35:48.465347 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 376/742] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:35:48 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 1720 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:35:48.842454 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-7f82ac71-0ffa-4036-b095-32abe4e6a8b7 req-4c9d456f-1694-45da-9c4a-c24922fab8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f043b14-af6f-4d95-a094-87fa6c768493", "name": "network-vif-deleted", "tag": "67582d29-a79f-4ee2-8844-18b26e15268b"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:35:48.844305 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:35:48.844305 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:35:48.852463 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-7f82ac71-0ffa-4036-b095-32abe4e6a8b7 req-4c9d456f-1694-45da-9c4a-c24922fab8e1 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:48.853197 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-7f82ac71-0ffa-4036-b095-32abe4e6a8b7 req-4c9d456f-1694-45da-9c4a-c24922fab8e1 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:48.865241 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-7f82ac71-0ffa-4036-b095-32abe4e6a8b7 req-4c9d456f-1694-45da-9c4a-c24922fab8e1 service nova] Creating event network-vif-deleted:67582d29-a79f-4ee2-8844-18b26e15268b for instance 3f043b14-af6f-4d95-a094-87fa6c768493 on hv-cinder-81080 Sep 24 03:35:48.871009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-7f82ac71-0ffa-4036-b095-32abe4e6a8b7 req-4c9d456f-1694-45da-9c4a-c24922fab8e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032388 Sep 24 03:35:48.871802 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 367/743] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:35:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:35:49.484043 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0d9ad1ea-6386-4988-9532-7c3445ac263b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:49.484781 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0d9ad1ea-6386-4988-9532-7c3445ac263b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:49.491542 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0d9ad1ea-6386-4988-9532-7c3445ac263b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:49.492021 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0d9ad1ea-6386-4988-9532-7c3445ac263b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:49.492910 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0d9ad1ea-6386-4988-9532-7c3445ac263b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:49.493326 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0d9ad1ea-6386-4988-9532-7c3445ac263b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:49.508876 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-0d9ad1ea-6386-4988-9532-7c3445ac263b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] HTTP exception thrown: Instance 3f043b14-af6f-4d95-a094-87fa6c768493 could not be found. Sep 24 03:35:49.509774 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0d9ad1ea-6386-4988-9532-7c3445ac263b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Returning 404 to user: Instance 3f043b14-af6f-4d95-a094-87fa6c768493 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:35:49.510608 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0d9ad1ea-6386-4988-9532-7c3445ac263b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 404 len: 111 microversion: 2.20 time: 0.030347 Sep 24 03:35:49.511170 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 377/744] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:35:49 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 03:35:49.520191 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-87e282e5-4b83-4106-810e-bed165bd82ce tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '.version_select at 0x7f6664220160>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:49.559414 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-87e282e5-4b83-4106-810e-bed165bd82ce tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-754460251" status: 204 len: 0 microversion: 2.20 time: 0.043117 Sep 24 03:35:49.560828 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 368/745] 10.222.0.18 () {60 vars in 1259 bytes} [Fri Sep 24 03:35:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-754460251 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 03:35:50.572279 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0033a0b5-4a81-4315-9bc3-8c9ad28afd25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'create', calling method: .version_select at 0x7f666433b310>, body: {"keypair": {"name": "tempest-keypair-1830593475"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:35:50.590816 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-0033a0b5-4a81-4315-9bc3-8c9ad28afd25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Getting quotas for project 591aadad4ac440c6afd8189aa7e5cee6. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:35:50.594555 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-0033a0b5-4a81-4315-9bc3-8c9ad28afd25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Getting quotas for user e8050cf3919a4e36865457a4c6568339 and project 591aadad4ac440c6afd8189aa7e5cee6. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:35:51.163509 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-0033a0b5-4a81-4315-9bc3-8c9ad28afd25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Getting quotas for project 591aadad4ac440c6afd8189aa7e5cee6. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:35:51.167197 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-0033a0b5-4a81-4315-9bc3-8c9ad28afd25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Getting quotas for user e8050cf3919a4e36865457a4c6568339 and project 591aadad4ac440c6afd8189aa7e5cee6. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:35:51.179540 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0033a0b5-4a81-4315-9bc3-8c9ad28afd25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.617050 Sep 24 03:35:51.180133 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 378/746] 10.222.0.18 () {62 vars in 1199 bytes} [Fri Sep 24 03:35:50 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 618 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 24 03:35:52.472093 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-233291808", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a46da72-dbc3-4033-9e4b-9bf85a1d2088"}], "security_groups": [{"name": "tempest-securitygroup--1019410644"}], "key_name": "tempest-keypair-1830593475", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:35:53.520013 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.network.neutron [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] validate_networks() for [('3a46da72-dbc3-4033-9e4b-9bf85a1d2088', None, None, None, None, None)] {{(pid=109375) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:35:53.885396 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Flavor limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:35:53.885850 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Image limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:35:53.886366 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Flavor pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:35:53.886840 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Image pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:35:53.887384 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:35:53.895979 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:53.896414 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:53.897200 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:53.897617 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:53.919276 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Getting quotas for project 591aadad4ac440c6afd8189aa7e5cee6. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:35:53.923364 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Getting quotas for user e8050cf3919a4e36865457a4c6568339 and project 591aadad4ac440c6afd8189aa7e5cee6. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:35:53.934501 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Going to run 1 instances... {{(pid=109375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:35:53.936923 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:35:53.986074 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1913eead-dfa2-4886-b7d4-480dea4607e6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.518017 Sep 24 03:35:53.986728 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 369/747] 10.222.0.18 () {62 vars in 1188 bytes} [Fri Sep 24 03:35:52 2021] POST /compute/v2.1/servers => generated 402 bytes in 1519 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 03:35:53.997395 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d3e9a58d-639f-403e-a9aa-a233af31f48f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:53.998081 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d3e9a58d-639f-403e-a9aa-a233af31f48f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:54.065413 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d3e9a58d-639f-403e-a9aa-a233af31f48f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:54.073111 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d3e9a58d-639f-403e-a9aa-a233af31f48f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:54.074685 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d3e9a58d-639f-403e-a9aa-a233af31f48f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:54.075790 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d3e9a58d-639f-403e-a9aa-a233af31f48f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1281 microversion: 2.20 time: 0.082708 Sep 24 03:35:54.076412 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 379/748] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:35:53 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:35:55.094208 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-7f7d24e3-f237-418e-9720-812ee63fa934 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:55.095460 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-7f7d24e3-f237-418e-9720-812ee63fa934 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:55.104306 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7f7d24e3-f237-418e-9720-812ee63fa934 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:55.104748 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7f7d24e3-f237-418e-9720-812ee63fa934 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:55.105648 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7f7d24e3-f237-418e-9720-812ee63fa934 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:55.105975 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7f7d24e3-f237-418e-9720-812ee63fa934 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:55.190590 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-7f7d24e3-f237-418e-9720-812ee63fa934 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:55.199945 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-7f7d24e3-f237-418e-9720-812ee63fa934 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:55.201502 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-7f7d24e3-f237-418e-9720-812ee63fa934 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:55.202678 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-7f7d24e3-f237-418e-9720-812ee63fa934 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1351 microversion: 2.20 time: 0.113381 Sep 24 03:35:55.203230 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 370/749] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:35:55 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:35:56.221084 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ea6887ea-f157-4aad-8ae2-8e4c8bad25bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:56.221886 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ea6887ea-f157-4aad-8ae2-8e4c8bad25bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:56.229695 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ea6887ea-f157-4aad-8ae2-8e4c8bad25bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:56.230428 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ea6887ea-f157-4aad-8ae2-8e4c8bad25bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:56.231382 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ea6887ea-f157-4aad-8ae2-8e4c8bad25bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:56.232131 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ea6887ea-f157-4aad-8ae2-8e4c8bad25bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:56.431487 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ea6887ea-f157-4aad-8ae2-8e4c8bad25bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:56.439388 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ea6887ea-f157-4aad-8ae2-8e4c8bad25bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:56.440871 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ea6887ea-f157-4aad-8ae2-8e4c8bad25bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:56.441999 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ea6887ea-f157-4aad-8ae2-8e4c8bad25bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1407 microversion: 2.20 time: 0.224743 Sep 24 03:35:56.442556 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 380/750] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:35:56 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:35:56.471276 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-45cf88f4-69ad-4a89-bbd6-2ee030fd05c2 req-e1f30b9e-8afd-4fd1-afab-3f482cb993f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722368e5-ae83-4303-be1a-5e1d2d40fe87", "tag": "8c1f1a3d-b239-4f20-8ebe-d00fa864b558"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:35:56.472900 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:35:56.472900 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:35:56.483319 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-45cf88f4-69ad-4a89-bbd6-2ee030fd05c2 req-e1f30b9e-8afd-4fd1-afab-3f482cb993f5 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:56.483767 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-45cf88f4-69ad-4a89-bbd6-2ee030fd05c2 req-e1f30b9e-8afd-4fd1-afab-3f482cb993f5 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:56.509354 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-45cf88f4-69ad-4a89-bbd6-2ee030fd05c2 req-e1f30b9e-8afd-4fd1-afab-3f482cb993f5 service nova] Creating event network-changed:8c1f1a3d-b239-4f20-8ebe-d00fa864b558 for instance 722368e5-ae83-4303-be1a-5e1d2d40fe87 on hv-cinder-81080 Sep 24 03:35:56.515339 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-45cf88f4-69ad-4a89-bbd6-2ee030fd05c2 req-e1f30b9e-8afd-4fd1-afab-3f482cb993f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048363 Sep 24 03:35:56.516149 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 371/751] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:35:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:35:56.724649 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c7e0b00d-c702-47e6-93fb-fb956a6bcb3f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:56.725579 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c7e0b00d-c702-47e6-93fb-fb956a6bcb3f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:56.732600 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7e0b00d-c702-47e6-93fb-fb956a6bcb3f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:56.733039 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7e0b00d-c702-47e6-93fb-fb956a6bcb3f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:56.734016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7e0b00d-c702-47e6-93fb-fb956a6bcb3f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:56.734450 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c7e0b00d-c702-47e6-93fb-fb956a6bcb3f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:56.764886 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c7e0b00d-c702-47e6-93fb-fb956a6bcb3f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043573 Sep 24 03:35:56.765536 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 381/752] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:35:56 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:35:56.828104 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d9b07757-1d66-4ed2-9e0f-611826ffefcc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:56.828861 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d9b07757-1d66-4ed2-9e0f-611826ffefcc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:56.835526 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d9b07757-1d66-4ed2-9e0f-611826ffefcc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:56.835966 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d9b07757-1d66-4ed2-9e0f-611826ffefcc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:56.836740 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d9b07757-1d66-4ed2-9e0f-611826ffefcc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:56.837741 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d9b07757-1d66-4ed2-9e0f-611826ffefcc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:56.871889 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d9b07757-1d66-4ed2-9e0f-611826ffefcc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Going to try to terminate instance {{(pid=109375) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:35:56.954251 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d9b07757-1d66-4ed2-9e0f-611826ffefcc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 204 len: 0 microversion: 2.1 time: 0.130586 Sep 24 03:35:56.954882 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 372/753] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:35:56 2021] DELETE /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:35:56.964618 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5a6610ad-236d-4de9-837c-689f3780c03d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:56.965224 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5a6610ad-236d-4de9-837c-689f3780c03d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:56.972401 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5a6610ad-236d-4de9-837c-689f3780c03d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:56.973268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5a6610ad-236d-4de9-837c-689f3780c03d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:56.974391 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5a6610ad-236d-4de9-837c-689f3780c03d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:56.975082 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5a6610ad-236d-4de9-837c-689f3780c03d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:57.174509 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5a6610ad-236d-4de9-837c-689f3780c03d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:57.185948 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5a6610ad-236d-4de9-837c-689f3780c03d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1671 microversion: 2.1 time: 0.226263 Sep 24 03:35:57.186737 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 382/754] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:56 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1671 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:35:57.460815 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-443ea882-b108-4f43-b9f8-b0ced9eec585 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:57.461424 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-443ea882-b108-4f43-b9f8-b0ced9eec585 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:57.467177 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-443ea882-b108-4f43-b9f8-b0ced9eec585 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:57.467624 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-443ea882-b108-4f43-b9f8-b0ced9eec585 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:57.468392 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-443ea882-b108-4f43-b9f8-b0ced9eec585 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:57.468830 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-443ea882-b108-4f43-b9f8-b0ced9eec585 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:57.637517 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-443ea882-b108-4f43-b9f8-b0ced9eec585 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:57.645225 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-443ea882-b108-4f43-b9f8-b0ced9eec585 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:57.647023 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-443ea882-b108-4f43-b9f8-b0ced9eec585 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:57.648115 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-443ea882-b108-4f43-b9f8-b0ced9eec585 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1407 microversion: 2.20 time: 0.191572 Sep 24 03:35:57.648673 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 373/755] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:35:57 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:35:58.203341 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b2436cd5-e649-4fc7-99b4-784fe99dbd0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:58.203941 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b2436cd5-e649-4fc7-99b4-784fe99dbd0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:58.209866 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b2436cd5-e649-4fc7-99b4-784fe99dbd0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:58.210308 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b2436cd5-e649-4fc7-99b4-784fe99dbd0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:58.211111 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b2436cd5-e649-4fc7-99b4-784fe99dbd0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:58.211538 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b2436cd5-e649-4fc7-99b4-784fe99dbd0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:58.334598 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b2436cd5-e649-4fc7-99b4-784fe99dbd0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:58.342990 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b2436cd5-e649-4fc7-99b4-784fe99dbd0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1671 microversion: 2.1 time: 0.143276 Sep 24 03:35:58.343624 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 383/756] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:58 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1671 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:58.663479 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9b7c824-2b2f-40a5-baaf-117cd6cabeb5] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 03:35:58.666790 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ad7d4200-c5fc-432d-b713-5c5e4d4b9103 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:58.667390 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ad7d4200-c5fc-432d-b713-5c5e4d4b9103 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:58.673193 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad7d4200-c5fc-432d-b713-5c5e4d4b9103 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:58.673642 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad7d4200-c5fc-432d-b713-5c5e4d4b9103 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:58.674590 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad7d4200-c5fc-432d-b713-5c5e4d4b9103 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:58.675130 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad7d4200-c5fc-432d-b713-5c5e4d4b9103 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:58.793521 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ad7d4200-c5fc-432d-b713-5c5e4d4b9103 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:58.801133 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ad7d4200-c5fc-432d-b713-5c5e4d4b9103 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:58.802761 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ad7d4200-c5fc-432d-b713-5c5e4d4b9103 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:58.803873 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ad7d4200-c5fc-432d-b713-5c5e4d4b9103 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1407 microversion: 2.20 time: 0.141863 Sep 24 03:35:58.804463 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 374/757] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:35:58 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:35:59.360348 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3099602b-2ae9-4186-8c65-d26e72cc528c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:59.360947 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3099602b-2ae9-4186-8c65-d26e72cc528c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:59.367011 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3099602b-2ae9-4186-8c65-d26e72cc528c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:59.367450 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3099602b-2ae9-4186-8c65-d26e72cc528c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:59.369037 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3099602b-2ae9-4186-8c65-d26e72cc528c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:59.369462 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3099602b-2ae9-4186-8c65-d26e72cc528c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:59.495512 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3099602b-2ae9-4186-8c65-d26e72cc528c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:35:59.502896 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3099602b-2ae9-4186-8c65-d26e72cc528c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1671 microversion: 2.1 time: 0.146630 Sep 24 03:35:59.503530 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 384/758] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:35:59 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1671 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:35:59.825373 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ec8dc5cf-6f2e-4360-8b9d-8f96c77c7828 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:35:59.825949 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ec8dc5cf-6f2e-4360-8b9d-8f96c77c7828 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:35:59.842825 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ec8dc5cf-6f2e-4360-8b9d-8f96c77c7828 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:59.843263 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ec8dc5cf-6f2e-4360-8b9d-8f96c77c7828 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:59.844204 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ec8dc5cf-6f2e-4360-8b9d-8f96c77c7828 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:35:59.844822 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ec8dc5cf-6f2e-4360-8b9d-8f96c77c7828 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:35:59.865483 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9b7c824-2b2f-40a5-baaf-117cd6cabeb5] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 50510. Sep 24 03:36:00.089234 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ec8dc5cf-6f2e-4360-8b9d-8f96c77c7828 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:00.098092 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ec8dc5cf-6f2e-4360-8b9d-8f96c77c7828 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:00.099930 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ec8dc5cf-6f2e-4360-8b9d-8f96c77c7828 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:00.101382 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ec8dc5cf-6f2e-4360-8b9d-8f96c77c7828 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1407 microversion: 2.20 time: 0.279928 Sep 24 03:36:00.102622 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 375/759] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:35:59 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:36:00.353839 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1f139ac7-3bc7-4e8b-985e-c145ec7b3187 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "626d68e4-5f5a-4e27-91be-fd7016687df4", "device": "/dev/sdb"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:00.355643 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1f139ac7-3bc7-4e8b-985e-c145ec7b3187 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:00.362013 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1f139ac7-3bc7-4e8b-985e-c145ec7b3187 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:00.362603 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1f139ac7-3bc7-4e8b-985e-c145ec7b3187 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:00.363215 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1f139ac7-3bc7-4e8b-985e-c145ec7b3187 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:00.363634 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1f139ac7-3bc7-4e8b-985e-c145ec7b3187 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:00.520318 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f25cbf17-7396-485c-9f57-dcc37924fb63 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:00.520924 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f25cbf17-7396-485c-9f57-dcc37924fb63 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:00.529206 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f25cbf17-7396-485c-9f57-dcc37924fb63 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:00.530941 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f25cbf17-7396-485c-9f57-dcc37924fb63 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:00.532235 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f25cbf17-7396-485c-9f57-dcc37924fb63 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:00.533019 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f25cbf17-7396-485c-9f57-dcc37924fb63 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:00.639333 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-f25cbf17-7396-485c-9f57-dcc37924fb63 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:00.643213 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1f139ac7-3bc7-4e8b-985e-c145ec7b3187 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "POST /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293206 Sep 24 03:36:00.643809 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 385/760] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:36:00 2021] POST /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:36:00.653538 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f25cbf17-7396-485c-9f57-dcc37924fb63 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 200 len: 1604 microversion: 2.1 time: 0.137018 Sep 24 03:36:00.654512 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 376/761] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:00 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 1604 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:00.732444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-c01adac6-dce1-4c6b-83e5-a37297ce5fcb req-1c7778a7-eeb4-4a4d-8cf7-eeba26e4c4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe", "name": "network-vif-deleted", "tag": "bb93edc3-4472-46cc-bc7d-748cad3a1f55"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:00.734595 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:36:00.734595 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:36:00.745900 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-c01adac6-dce1-4c6b-83e5-a37297ce5fcb req-1c7778a7-eeb4-4a4d-8cf7-eeba26e4c4ba service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:00.746633 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-c01adac6-dce1-4c6b-83e5-a37297ce5fcb req-1c7778a7-eeb4-4a4d-8cf7-eeba26e4c4ba service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:00.759094 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-c01adac6-dce1-4c6b-83e5-a37297ce5fcb req-1c7778a7-eeb4-4a4d-8cf7-eeba26e4c4ba service nova] Creating event network-vif-deleted:bb93edc3-4472-46cc-bc7d-748cad3a1f55 for instance 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe on hv-cinder-81080 Sep 24 03:36:00.768118 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-c01adac6-dce1-4c6b-83e5-a37297ce5fcb req-1c7778a7-eeb4-4a4d-8cf7-eeba26e4c4ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040959 Sep 24 03:36:00.771853 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 386/762] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:36:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:36:01.120374 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d966d86a-b5a6-408f-a392-966c110f7aab tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:01.120985 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d966d86a-b5a6-408f-a392-966c110f7aab tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:01.127250 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d966d86a-b5a6-408f-a392-966c110f7aab tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:01.127723 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d966d86a-b5a6-408f-a392-966c110f7aab tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:01.128485 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d966d86a-b5a6-408f-a392-966c110f7aab tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:01.128910 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d966d86a-b5a6-408f-a392-966c110f7aab tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:01.271466 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d966d86a-b5a6-408f-a392-966c110f7aab tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:01.280702 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d966d86a-b5a6-408f-a392-966c110f7aab tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:01.282211 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d966d86a-b5a6-408f-a392-966c110f7aab tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:01.283304 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d966d86a-b5a6-408f-a392-966c110f7aab tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1407 microversion: 2.20 time: 0.166928 Sep 24 03:36:01.296938 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 377/763] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:36:01 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:36:01.671645 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2f3f9c12-1df3-43e4-aa61-960bd142ed9b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:01.672405 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2f3f9c12-1df3-43e4-aa61-960bd142ed9b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:01.678735 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f3f9c12-1df3-43e4-aa61-960bd142ed9b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:01.679286 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f3f9c12-1df3-43e4-aa61-960bd142ed9b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:01.680112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f3f9c12-1df3-43e4-aa61-960bd142ed9b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:01.680801 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f3f9c12-1df3-43e4-aa61-960bd142ed9b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:01.693920 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-2f3f9c12-1df3-43e4-aa61-960bd142ed9b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] HTTP exception thrown: Instance 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe could not be found. Sep 24 03:36:01.694501 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2f3f9c12-1df3-43e4-aa61-960bd142ed9b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Returning 404 to user: Instance 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:36:01.695313 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2f3f9c12-1df3-43e4-aa61-960bd142ed9b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 404 len: 111 microversion: 2.1 time: 0.028507 Sep 24 03:36:01.695854 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 387/764] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:01 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:36:01.704953 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-12d6d547-a628-40c4-9b89-f5bc9cc80502 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '.version_select at 0x7f6664229550>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:01.727782 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-12d6d547-a628-40c4-9b89-f5bc9cc80502 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-916254361" status: 202 len: 0 microversion: 2.1 time: 0.026479 Sep 24 03:36:01.731892 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 378/765] 10.222.0.18 () {58 vars in 1218 bytes} [Fri Sep 24 03:36:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-916254361 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:02.074831 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-cc006c57-914a-4374-92fc-80b734a382fe req-e4986454-1b92-4b66-ba32-3988c510160f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722368e5-ae83-4303-be1a-5e1d2d40fe87", "name": "network-vif-plugged", "status": "completed", "tag": "8c1f1a3d-b239-4f20-8ebe-d00fa864b558"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:02.076675 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:36:02.076675 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:36:02.084936 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-cc006c57-914a-4374-92fc-80b734a382fe req-e4986454-1b92-4b66-ba32-3988c510160f service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:02.085376 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-cc006c57-914a-4374-92fc-80b734a382fe req-e4986454-1b92-4b66-ba32-3988c510160f service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:02.102622 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-cc006c57-914a-4374-92fc-80b734a382fe req-e4986454-1b92-4b66-ba32-3988c510160f service nova] Creating event network-vif-plugged:8c1f1a3d-b239-4f20-8ebe-d00fa864b558 for instance 722368e5-ae83-4303-be1a-5e1d2d40fe87 on hv-cinder-81080 Sep 24 03:36:02.108037 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-cc006c57-914a-4374-92fc-80b734a382fe req-e4986454-1b92-4b66-ba32-3988c510160f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037306 Sep 24 03:36:02.108991 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 388/766] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:36:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:36:02.303749 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-877d423a-45f6-4c3f-a9f8-448f8fe04954 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:02.304896 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-877d423a-45f6-4c3f-a9f8-448f8fe04954 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:02.312490 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-877d423a-45f6-4c3f-a9f8-448f8fe04954 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:02.312922 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-877d423a-45f6-4c3f-a9f8-448f8fe04954 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:02.313695 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-877d423a-45f6-4c3f-a9f8-448f8fe04954 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:02.314171 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-877d423a-45f6-4c3f-a9f8-448f8fe04954 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:02.432076 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-acfd9bec-dccb-4b28-85e1-0336c60609e2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'create', calling method: .version_select at 0x7f6664175790>, body: {"keypair": {"name": "tempest-keypair-710770459"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:02.449883 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-acfd9bec-dccb-4b28-85e1-0336c60609e2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Getting quotas for project b959a04e215f4456becf31ac01fa6e25. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:36:02.452257 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-877d423a-45f6-4c3f-a9f8-448f8fe04954 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:02.453574 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-acfd9bec-dccb-4b28-85e1-0336c60609e2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Getting quotas for user 9abc927649fe4781829fe7d7b8851333 and project b959a04e215f4456becf31ac01fa6e25. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:36:02.460009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-877d423a-45f6-4c3f-a9f8-448f8fe04954 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:02.461605 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-877d423a-45f6-4c3f-a9f8-448f8fe04954 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:02.463069 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-877d423a-45f6-4c3f-a9f8-448f8fe04954 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1407 microversion: 2.20 time: 0.163111 Sep 24 03:36:02.463711 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 379/767] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:36:02 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:36:02.770328 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-acfd9bec-dccb-4b28-85e1-0336c60609e2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Getting quotas for project b959a04e215f4456becf31ac01fa6e25. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:36:02.774889 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-acfd9bec-dccb-4b28-85e1-0336c60609e2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Getting quotas for user 9abc927649fe4781829fe7d7b8851333 and project b959a04e215f4456becf31ac01fa6e25. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:36:02.788107 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-acfd9bec-dccb-4b28-85e1-0336c60609e2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.363150 Sep 24 03:36:02.788710 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 389/768] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Sep 24 03:36:02 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:03.480595 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d4a069d8-6b8b-4692-bbe1-e042547f104a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:03.481788 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d4a069d8-6b8b-4692-bbe1-e042547f104a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:03.488182 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d4a069d8-6b8b-4692-bbe1-e042547f104a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:03.488766 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d4a069d8-6b8b-4692-bbe1-e042547f104a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:03.489544 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d4a069d8-6b8b-4692-bbe1-e042547f104a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:03.489945 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d4a069d8-6b8b-4692-bbe1-e042547f104a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:03.916851 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d4a069d8-6b8b-4692-bbe1-e042547f104a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:03.924447 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d4a069d8-6b8b-4692-bbe1-e042547f104a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:03.926116 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d4a069d8-6b8b-4692-bbe1-e042547f104a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:03.927300 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d4a069d8-6b8b-4692-bbe1-e042547f104a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1407 microversion: 2.20 time: 0.450956 Sep 24 03:36:03.927939 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 380/769] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:36:03 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:36:04.334767 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1478851702", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cba65e79-4fc5-4461-a342-04d626e59a47"}], "security_groups": [{"name": "tempest-securitygroup--617594302"}], "key_name": "tempest-keypair-710770459", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:04.423357 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.network.neutron [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] validate_networks() for [('cba65e79-4fc5-4461-a342-04d626e59a47', None, None, None, None, None)] {{(pid=109374) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:36:04.793681 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Flavor limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:36:04.793681 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Image limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:36:04.794320 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Flavor pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:36:04.794788 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Image pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:36:04.795360 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:36:04.807436 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:04.807882 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:04.808671 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:04.809094 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:04.825180 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Getting quotas for project b959a04e215f4456becf31ac01fa6e25. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:36:04.829275 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Getting quotas for user 9abc927649fe4781829fe7d7b8851333 and project b959a04e215f4456becf31ac01fa6e25. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:36:04.840902 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Going to run 1 instances... {{(pid=109374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:36:04.843338 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:36:04.897570 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-cd2aa687-7a0f-47db-bd93-4638bc56220a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.567229 Sep 24 03:36:04.899030 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 390/770] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:36:04 2021] POST /compute/v2.1/servers => generated 401 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:36:04.915795 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-cd9f5f35-072c-4e3c-b444-182a985022ed tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:04.916919 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-cd9f5f35-072c-4e3c-b444-182a985022ed tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:04.955123 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4d60434f-89da-43b4-b976-b2e4fe72998d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:04.955897 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4d60434f-89da-43b4-b976-b2e4fe72998d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:04.968210 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4d60434f-89da-43b4-b976-b2e4fe72998d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:04.969223 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4d60434f-89da-43b4-b976-b2e4fe72998d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:04.970843 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4d60434f-89da-43b4-b976-b2e4fe72998d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:04.971620 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4d60434f-89da-43b4-b976-b2e4fe72998d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:05.013760 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-cd9f5f35-072c-4e3c-b444-182a985022ed tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:05.022425 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-cd9f5f35-072c-4e3c-b444-182a985022ed tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1237 microversion: 2.1 time: 0.111125 Sep 24 03:36:05.037432 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 381/771] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:04 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:05.120221 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4d60434f-89da-43b4-b976-b2e4fe72998d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:05.128430 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4d60434f-89da-43b4-b976-b2e4fe72998d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:05.129942 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4d60434f-89da-43b4-b976-b2e4fe72998d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:05.131089 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4d60434f-89da-43b4-b976-b2e4fe72998d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1598 microversion: 2.20 time: 0.187263 Sep 24 03:36:05.131642 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 391/772] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:36:04 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1598 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:36:05.148152 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-cd382619-5749-46b1-b80d-e8777b601d7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:05.148972 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-cd382619-5749-46b1-b80d-e8777b601d7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:05.157449 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cd382619-5749-46b1-b80d-e8777b601d7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:05.157916 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cd382619-5749-46b1-b80d-e8777b601d7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:05.169290 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cd382619-5749-46b1-b80d-e8777b601d7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:05.169983 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cd382619-5749-46b1-b80d-e8777b601d7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:05.252246 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-cd382619-5749-46b1-b80d-e8777b601d7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107832 Sep 24 03:36:05.252846 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 382/773] 10.222.0.18 () {60 vars in 1316 bytes} [Fri Sep 24 03:36:05 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:36:06.044415 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-061fd249-9e4c-4f87-99cd-91305da19eb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:06.045605 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-061fd249-9e4c-4f87-99cd-91305da19eb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:06.058129 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-061fd249-9e4c-4f87-99cd-91305da19eb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:06.058586 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-061fd249-9e4c-4f87-99cd-91305da19eb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:06.059501 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-061fd249-9e4c-4f87-99cd-91305da19eb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:06.059910 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-061fd249-9e4c-4f87-99cd-91305da19eb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:06.165573 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-061fd249-9e4c-4f87-99cd-91305da19eb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:06.174770 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-061fd249-9e4c-4f87-99cd-91305da19eb4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1307 microversion: 2.1 time: 0.138034 Sep 24 03:36:06.175796 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 392/774] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:06 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1307 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:06.573500 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-0000ad28-3aee-472f-92fb-93796b7ea2c7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:06.574564 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-0000ad28-3aee-472f-92fb-93796b7ea2c7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:06.577736 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-148aaa23-0fbd-4f0d-8207-b93cb5ef196a req-d06921ab-74a6-46bd-a03c-5fc1933f4929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722368e5-ae83-4303-be1a-5e1d2d40fe87", "tag": "8c1f1a3d-b239-4f20-8ebe-d00fa864b558"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:06.579412 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:36:06.579412 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:36:06.587679 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-148aaa23-0fbd-4f0d-8207-b93cb5ef196a req-d06921ab-74a6-46bd-a03c-5fc1933f4929 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:06.589114 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-148aaa23-0fbd-4f0d-8207-b93cb5ef196a req-d06921ab-74a6-46bd-a03c-5fc1933f4929 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:06.595491 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0000ad28-3aee-472f-92fb-93796b7ea2c7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:06.595943 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0000ad28-3aee-472f-92fb-93796b7ea2c7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:06.596792 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0000ad28-3aee-472f-92fb-93796b7ea2c7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:06.597157 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0000ad28-3aee-472f-92fb-93796b7ea2c7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:06.604224 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-148aaa23-0fbd-4f0d-8207-b93cb5ef196a req-d06921ab-74a6-46bd-a03c-5fc1933f4929 service nova] Creating event network-changed:8c1f1a3d-b239-4f20-8ebe-d00fa864b558 for instance 722368e5-ae83-4303-be1a-5e1d2d40fe87 on hv-cinder-81080 Sep 24 03:36:06.610825 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-148aaa23-0fbd-4f0d-8207-b93cb5ef196a req-d06921ab-74a6-46bd-a03c-5fc1933f4929 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043020 Sep 24 03:36:06.612340 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 393/775] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:36:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:36:06.705154 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-0000ad28-3aee-472f-92fb-93796b7ea2c7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 14 microversion: 2.20 time: 0.141223 Sep 24 03:36:06.710087 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 383/776] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:06 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:07.193369 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-232aa0f5-a216-4866-8269-0c906ad4e8f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:07.195283 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-232aa0f5-a216-4866-8269-0c906ad4e8f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:07.203011 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-232aa0f5-a216-4866-8269-0c906ad4e8f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:07.203538 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-232aa0f5-a216-4866-8269-0c906ad4e8f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:07.204568 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-232aa0f5-a216-4866-8269-0c906ad4e8f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:07.205198 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-232aa0f5-a216-4866-8269-0c906ad4e8f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:07.527564 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-232aa0f5-a216-4866-8269-0c906ad4e8f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:07.535279 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-232aa0f5-a216-4866-8269-0c906ad4e8f5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1295 microversion: 2.1 time: 0.346219 Sep 24 03:36:07.535868 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 394/777] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:07 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1295 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:07.723643 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f2a3d057-a02b-4e99-a8a9-a0f05284d6bf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:07.725239 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f2a3d057-a02b-4e99-a8a9-a0f05284d6bf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:07.733883 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f2a3d057-a02b-4e99-a8a9-a0f05284d6bf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:07.734559 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f2a3d057-a02b-4e99-a8a9-a0f05284d6bf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:07.735535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f2a3d057-a02b-4e99-a8a9-a0f05284d6bf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:07.736332 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f2a3d057-a02b-4e99-a8a9-a0f05284d6bf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:07.800884 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f2a3d057-a02b-4e99-a8a9-a0f05284d6bf tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 14 microversion: 2.20 time: 0.082975 Sep 24 03:36:07.801646 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 384/778] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:07 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:08.557020 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5207d1df-9d99-40ba-920c-4980034a5023 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:08.558052 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5207d1df-9d99-40ba-920c-4980034a5023 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:08.567889 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5207d1df-9d99-40ba-920c-4980034a5023 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:08.569089 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5207d1df-9d99-40ba-920c-4980034a5023 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:08.570058 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5207d1df-9d99-40ba-920c-4980034a5023 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:08.574334 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5207d1df-9d99-40ba-920c-4980034a5023 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:08.819548 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-913a5ebf-2260-401f-ad5e-6548b9aec0e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:08.823104 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-913a5ebf-2260-401f-ad5e-6548b9aec0e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:08.840894 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-913a5ebf-2260-401f-ad5e-6548b9aec0e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:08.842121 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-913a5ebf-2260-401f-ad5e-6548b9aec0e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:08.843129 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-913a5ebf-2260-401f-ad5e-6548b9aec0e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:08.843890 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-913a5ebf-2260-401f-ad5e-6548b9aec0e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:08.886030 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5207d1df-9d99-40ba-920c-4980034a5023 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:08.897172 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5207d1df-9d99-40ba-920c-4980034a5023 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.348401 Sep 24 03:36:08.911214 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 395/779] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:08 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:09.101571 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-8e9d66fa-4bcb-41df-9488-fa2a4563e183 req-8e211823-c564-40a4-a38f-8e8c45e82810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ac17a6-46c5-4217-bfc1-b592f3ddd132", "tag": "2a9f0597-3e1c-4f71-8e1d-3016b73e3e60"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:09.106563 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:36:09.106563 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:36:09.128597 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-8e9d66fa-4bcb-41df-9488-fa2a4563e183 req-8e211823-c564-40a4-a38f-8e8c45e82810 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:09.132429 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-8e9d66fa-4bcb-41df-9488-fa2a4563e183 req-8e211823-c564-40a4-a38f-8e8c45e82810 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:09.151108 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-8e9d66fa-4bcb-41df-9488-fa2a4563e183 req-8e211823-c564-40a4-a38f-8e8c45e82810 service nova] Creating event network-changed:2a9f0597-3e1c-4f71-8e1d-3016b73e3e60 for instance e1ac17a6-46c5-4217-bfc1-b592f3ddd132 on hv-cinder-81080 Sep 24 03:36:09.164018 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-8e9d66fa-4bcb-41df-9488-fa2a4563e183 req-8e211823-c564-40a4-a38f-8e8c45e82810 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066413 Sep 24 03:36:09.176122 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 396/780] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:36:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:36:09.929288 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ac75c8e5-95f7-47a1-924c-7a954a2f22e9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:09.931342 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ac75c8e5-95f7-47a1-924c-7a954a2f22e9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:09.937630 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ac75c8e5-95f7-47a1-924c-7a954a2f22e9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:09.938110 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ac75c8e5-95f7-47a1-924c-7a954a2f22e9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:09.939050 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ac75c8e5-95f7-47a1-924c-7a954a2f22e9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:09.939483 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ac75c8e5-95f7-47a1-924c-7a954a2f22e9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:10.078531 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ac75c8e5-95f7-47a1-924c-7a954a2f22e9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:10.086476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ac75c8e5-95f7-47a1-924c-7a954a2f22e9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.161205 Sep 24 03:36:10.087586 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 397/781] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:09 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:11.102958 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9b7639c3-22f7-4ec0-87b4-8162488bd7b5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:11.103630 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9b7639c3-22f7-4ec0-87b4-8162488bd7b5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:11.109275 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9b7639c3-22f7-4ec0-87b4-8162488bd7b5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:11.109734 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9b7639c3-22f7-4ec0-87b4-8162488bd7b5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:11.110513 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9b7639c3-22f7-4ec0-87b4-8162488bd7b5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:11.110948 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9b7639c3-22f7-4ec0-87b4-8162488bd7b5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:11.251930 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-9b7639c3-22f7-4ec0-87b4-8162488bd7b5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:11.260369 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9b7639c3-22f7-4ec0-87b4-8162488bd7b5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.161160 Sep 24 03:36:11.261191 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 398/782] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:11 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:11.644121 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-913a5ebf-2260-401f-ad5e-6548b9aec0e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 14 microversion: 2.20 time: 2.835048 Sep 24 03:36:11.644910 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 385/783] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:08 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 14 bytes in 2837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:12.277228 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ba57f210-a5f5-4006-a5fc-4a71e54eb20b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:12.277892 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ba57f210-a5f5-4006-a5fc-4a71e54eb20b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:12.284106 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ba57f210-a5f5-4006-a5fc-4a71e54eb20b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:12.284552 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ba57f210-a5f5-4006-a5fc-4a71e54eb20b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:12.285536 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ba57f210-a5f5-4006-a5fc-4a71e54eb20b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:12.286013 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ba57f210-a5f5-4006-a5fc-4a71e54eb20b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:12.417908 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ba57f210-a5f5-4006-a5fc-4a71e54eb20b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:12.428517 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ba57f210-a5f5-4006-a5fc-4a71e54eb20b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.155500 Sep 24 03:36:12.429827 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 399/784] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:12 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:12.658228 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f7da7169-ab14-4c3f-9b34-6c5a1bd833bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:12.660382 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f7da7169-ab14-4c3f-9b34-6c5a1bd833bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:12.668678 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f7da7169-ab14-4c3f-9b34-6c5a1bd833bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:12.669621 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f7da7169-ab14-4c3f-9b34-6c5a1bd833bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:12.670661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f7da7169-ab14-4c3f-9b34-6c5a1bd833bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:12.671241 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f7da7169-ab14-4c3f-9b34-6c5a1bd833bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:13.448527 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1ecfb6ce-ac52-4a3b-99e9-94274722cdf6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:13.449125 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1ecfb6ce-ac52-4a3b-99e9-94274722cdf6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:13.455190 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1ecfb6ce-ac52-4a3b-99e9-94274722cdf6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:13.455630 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1ecfb6ce-ac52-4a3b-99e9-94274722cdf6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:13.456387 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1ecfb6ce-ac52-4a3b-99e9-94274722cdf6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:13.456810 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1ecfb6ce-ac52-4a3b-99e9-94274722cdf6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:13.650692 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1ecfb6ce-ac52-4a3b-99e9-94274722cdf6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:13.659998 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1ecfb6ce-ac52-4a3b-99e9-94274722cdf6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.216681 Sep 24 03:36:13.660894 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 400/785] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:13 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:14.681662 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-496dd0e6-ac2a-47a0-a3fc-83df3ba7c08a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:14.683013 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-496dd0e6-ac2a-47a0-a3fc-83df3ba7c08a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:14.696184 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-496dd0e6-ac2a-47a0-a3fc-83df3ba7c08a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:14.697077 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-496dd0e6-ac2a-47a0-a3fc-83df3ba7c08a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:14.697979 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-496dd0e6-ac2a-47a0-a3fc-83df3ba7c08a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:14.698628 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-496dd0e6-ac2a-47a0-a3fc-83df3ba7c08a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:14.837928 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f7da7169-ab14-4c3f-9b34-6c5a1bd833bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 14 microversion: 2.20 time: 2.185900 Sep 24 03:36:14.838583 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 386/786] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:12 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 14 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:15.358064 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-496dd0e6-ac2a-47a0-a3fc-83df3ba7c08a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:15.366965 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-496dd0e6-ac2a-47a0-a3fc-83df3ba7c08a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.692333 Sep 24 03:36:15.369874 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 401/787] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:14 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:15.849346 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9c356e06-6bad-41d8-840f-5cfce2739ce8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:15.850410 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9c356e06-6bad-41d8-840f-5cfce2739ce8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:15.857486 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c356e06-6bad-41d8-840f-5cfce2739ce8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:15.859840 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c356e06-6bad-41d8-840f-5cfce2739ce8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:15.862052 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c356e06-6bad-41d8-840f-5cfce2739ce8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:15.862509 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9c356e06-6bad-41d8-840f-5cfce2739ce8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:16.387471 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2c5a37e0-d13a-4af2-a7b1-aa50deb7ea0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:16.390737 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2c5a37e0-d13a-4af2-a7b1-aa50deb7ea0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:16.398316 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2c5a37e0-d13a-4af2-a7b1-aa50deb7ea0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:16.399372 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2c5a37e0-d13a-4af2-a7b1-aa50deb7ea0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:16.400398 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2c5a37e0-d13a-4af2-a7b1-aa50deb7ea0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:16.400921 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2c5a37e0-d13a-4af2-a7b1-aa50deb7ea0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:16.996013 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2c5a37e0-d13a-4af2-a7b1-aa50deb7ea0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:17.003602 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2c5a37e0-d13a-4af2-a7b1-aa50deb7ea0a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.621191 Sep 24 03:36:17.004237 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 402/788] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:16 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:17.583210 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2efbf4e1-063b-474e-a8a2-d0b4ad0cca97 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Action: 'create', calling method: .version_select at 0x7f666406b790>, body: {"keypair": {"name": "tempest-TestShelveInstance-786959083"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:17.602605 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-2efbf4e1-063b-474e-a8a2-d0b4ad0cca97 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Getting quotas for project 69c1af3d8fb24a3ea2c05a5b9d852f84. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:36:17.606398 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-2efbf4e1-063b-474e-a8a2-d0b4ad0cca97 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Getting quotas for user 37b84611e0b0496d9d5f6d24d180b567 and project 69c1af3d8fb24a3ea2c05a5b9d852f84. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:36:17.961056 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9c356e06-6bad-41d8-840f-5cfce2739ce8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 14 microversion: 2.20 time: 2.115536 Sep 24 03:36:17.962909 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 387/789] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:15 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 14 bytes in 2118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:18.020826 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c9d96748-b9ed-481a-be4a-5d9c8901adbe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:18.022059 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c9d96748-b9ed-481a-be4a-5d9c8901adbe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:18.029792 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c9d96748-b9ed-481a-be4a-5d9c8901adbe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:18.030745 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c9d96748-b9ed-481a-be4a-5d9c8901adbe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:18.031914 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c9d96748-b9ed-481a-be4a-5d9c8901adbe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:18.032644 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c9d96748-b9ed-481a-be4a-5d9c8901adbe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:18.066896 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-2efbf4e1-063b-474e-a8a2-d0b4ad0cca97 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Getting quotas for project 69c1af3d8fb24a3ea2c05a5b9d852f84. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:36:18.072628 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-2efbf4e1-063b-474e-a8a2-d0b4ad0cca97 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Getting quotas for user 37b84611e0b0496d9d5f6d24d180b567 and project 69c1af3d8fb24a3ea2c05a5b9d852f84. Resources: {'key_pairs'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:36:18.089807 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2efbf4e1-063b-474e-a8a2-d0b4ad0cca97 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.607761 Sep 24 03:36:18.090666 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 403/790] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Sep 24 03:36:17 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:18.331731 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c9d96748-b9ed-481a-be4a-5d9c8901adbe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:18.339629 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c9d96748-b9ed-481a-be4a-5d9c8901adbe tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.322704 Sep 24 03:36:18.340319 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 388/791] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:18 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:18.972477 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f8c95e84-e9a8-419a-a4c2-1206baf63eb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:18.973365 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f8c95e84-e9a8-419a-a4c2-1206baf63eb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:18.980230 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f8c95e84-e9a8-419a-a4c2-1206baf63eb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:18.980607 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f8c95e84-e9a8-419a-a4c2-1206baf63eb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:18.981543 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f8c95e84-e9a8-419a-a4c2-1206baf63eb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:18.982008 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f8c95e84-e9a8-419a-a4c2-1206baf63eb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:19.045470 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f8c95e84-e9a8-419a-a4c2-1206baf63eb3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 14 microversion: 2.20 time: 0.076582 Sep 24 03:36:19.048620 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 404/792] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:18 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:19.357246 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3ffa7b18-5b44-4f69-b8c8-4c898ca6e323 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:19.357916 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3ffa7b18-5b44-4f69-b8c8-4c898ca6e323 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:19.364449 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ffa7b18-5b44-4f69-b8c8-4c898ca6e323 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:19.365060 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ffa7b18-5b44-4f69-b8c8-4c898ca6e323 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:19.365882 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ffa7b18-5b44-4f69-b8c8-4c898ca6e323 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:19.366470 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ffa7b18-5b44-4f69-b8c8-4c898ca6e323 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:19.522605 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-3ffa7b18-5b44-4f69-b8c8-4c898ca6e323 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:19.531488 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3ffa7b18-5b44-4f69-b8c8-4c898ca6e323 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.178094 Sep 24 03:36:19.532141 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 389/793] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:19 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:20.057640 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3ea6f774-f168-49f5-9c3f-363577730aa0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:20.058614 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3ea6f774-f168-49f5-9c3f-363577730aa0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:20.065032 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3ea6f774-f168-49f5-9c3f-363577730aa0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:20.065476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3ea6f774-f168-49f5-9c3f-363577730aa0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:20.066265 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3ea6f774-f168-49f5-9c3f-363577730aa0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:20.066691 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3ea6f774-f168-49f5-9c3f-363577730aa0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:20.548858 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-be3bb8b8-983c-4918-99cf-5c339c2f30e6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:20.549663 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-be3bb8b8-983c-4918-99cf-5c339c2f30e6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:20.558322 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-be3bb8b8-983c-4918-99cf-5c339c2f30e6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:20.558773 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-be3bb8b8-983c-4918-99cf-5c339c2f30e6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:20.559696 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-be3bb8b8-983c-4918-99cf-5c339c2f30e6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:20.560124 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-be3bb8b8-983c-4918-99cf-5c339c2f30e6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:20.745065 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-be3bb8b8-983c-4918-99cf-5c339c2f30e6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:20.756448 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-be3bb8b8-983c-4918-99cf-5c339c2f30e6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.211652 Sep 24 03:36:20.757352 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 390/794] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:20 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:21.772321 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-66e25088-2b49-4ab0-b109-e3796b5cfc60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:21.772960 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-66e25088-2b49-4ab0-b109-e3796b5cfc60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:21.779149 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-66e25088-2b49-4ab0-b109-e3796b5cfc60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:21.779615 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-66e25088-2b49-4ab0-b109-e3796b5cfc60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:21.780376 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-66e25088-2b49-4ab0-b109-e3796b5cfc60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:21.780886 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-66e25088-2b49-4ab0-b109-e3796b5cfc60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:21.903469 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-66e25088-2b49-4ab0-b109-e3796b5cfc60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:21.911402 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-66e25088-2b49-4ab0-b109-e3796b5cfc60 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.142688 Sep 24 03:36:21.911971 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 391/795] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:21 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:22.419851 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3ea6f774-f168-49f5-9c3f-363577730aa0 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 18498 microversion: 2.20 time: 2.366864 Sep 24 03:36:22.421756 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 405/796] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:20 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 18498 bytes in 2370 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:22.928775 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d903ec7d-e003-4afc-91ec-37680e9c058d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:22.929379 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d903ec7d-e003-4afc-91ec-37680e9c058d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:22.936960 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d903ec7d-e003-4afc-91ec-37680e9c058d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:22.937408 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d903ec7d-e003-4afc-91ec-37680e9c058d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:22.938332 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d903ec7d-e003-4afc-91ec-37680e9c058d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:22.938761 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d903ec7d-e003-4afc-91ec-37680e9c058d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:23.061295 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d903ec7d-e003-4afc-91ec-37680e9c058d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:23.068584 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d903ec7d-e003-4afc-91ec-37680e9c058d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.143601 Sep 24 03:36:23.069157 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 392/797] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:22 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:23.433163 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b005cc5a-b6bb-4bff-a1fd-59c330ad922f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:23.434190 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b005cc5a-b6bb-4bff-a1fd-59c330ad922f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:23.440656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b005cc5a-b6bb-4bff-a1fd-59c330ad922f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:23.441099 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b005cc5a-b6bb-4bff-a1fd-59c330ad922f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:23.441910 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b005cc5a-b6bb-4bff-a1fd-59c330ad922f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:23.442341 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b005cc5a-b6bb-4bff-a1fd-59c330ad922f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:23.525576 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b005cc5a-b6bb-4bff-a1fd-59c330ad922f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 19342 microversion: 2.20 time: 0.097210 Sep 24 03:36:23.529314 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 406/798] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:23 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 19342 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:24.087182 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-27080cda-ca47-444f-93d8-3fe479965149 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:24.087887 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-27080cda-ca47-444f-93d8-3fe479965149 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:24.093819 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-27080cda-ca47-444f-93d8-3fe479965149 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:24.094268 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-27080cda-ca47-444f-93d8-3fe479965149 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:24.095035 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-27080cda-ca47-444f-93d8-3fe479965149 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:24.095467 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-27080cda-ca47-444f-93d8-3fe479965149 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:24.213786 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-27080cda-ca47-444f-93d8-3fe479965149 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:24.220849 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-27080cda-ca47-444f-93d8-3fe479965149 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.138116 Sep 24 03:36:24.221410 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 393/799] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:24 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:24.537432 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ac0c33c7-0829-409e-9bb0-8594f291b1e9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:24.538471 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ac0c33c7-0829-409e-9bb0-8594f291b1e9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:24.545914 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ac0c33c7-0829-409e-9bb0-8594f291b1e9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:24.546357 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ac0c33c7-0829-409e-9bb0-8594f291b1e9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:24.547144 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ac0c33c7-0829-409e-9bb0-8594f291b1e9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:24.547647 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ac0c33c7-0829-409e-9bb0-8594f291b1e9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:24.622943 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ac0c33c7-0829-409e-9bb0-8594f291b1e9 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 21935 microversion: 2.20 time: 0.089364 Sep 24 03:36:24.624238 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 407/800] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:24 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 21935 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:25.340104 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2ea57578-b9e6-43c2-b121-947f06f1944e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:25.340713 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2ea57578-b9e6-43c2-b121-947f06f1944e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:25.346533 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2ea57578-b9e6-43c2-b121-947f06f1944e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:25.346973 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2ea57578-b9e6-43c2-b121-947f06f1944e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:25.347726 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2ea57578-b9e6-43c2-b121-947f06f1944e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:25.348148 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2ea57578-b9e6-43c2-b121-947f06f1944e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:25.636106 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1167bf4d-a7ee-462a-a77c-60c56d02f344 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:25.637141 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1167bf4d-a7ee-462a-a77c-60c56d02f344 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:25.644638 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1167bf4d-a7ee-462a-a77c-60c56d02f344 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:25.644972 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1167bf4d-a7ee-462a-a77c-60c56d02f344 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:25.645791 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1167bf4d-a7ee-462a-a77c-60c56d02f344 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:25.646225 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1167bf4d-a7ee-462a-a77c-60c56d02f344 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:25.718186 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2ea57578-b9e6-43c2-b121-947f06f1944e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:25.727693 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2ea57578-b9e6-43c2-b121-947f06f1944e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.494276 Sep 24 03:36:25.728514 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 394/801] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:25 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:25.733236 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-cfee35d8-64ec-4b20-bf69-617791cfed75 req-013b1b37-c878-4b55-a14b-125d13f28627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ac17a6-46c5-4217-bfc1-b592f3ddd132", "name": "network-vif-plugged", "status": "completed", "tag": "2a9f0597-3e1c-4f71-8e1d-3016b73e3e60"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:25.734965 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:36:25.734965 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:36:25.741156 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1167bf4d-a7ee-462a-a77c-60c56d02f344 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 23184 microversion: 2.20 time: 0.109730 Sep 24 03:36:25.742416 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 408/802] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:25 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 23184 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:36:25.743264 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-cfee35d8-64ec-4b20-bf69-617791cfed75 req-013b1b37-c878-4b55-a14b-125d13f28627 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:25.743713 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-cfee35d8-64ec-4b20-bf69-617791cfed75 req-013b1b37-c878-4b55-a14b-125d13f28627 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:25.755460 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-cfee35d8-64ec-4b20-bf69-617791cfed75 req-013b1b37-c878-4b55-a14b-125d13f28627 service nova] Creating event network-vif-plugged:2a9f0597-3e1c-4f71-8e1d-3016b73e3e60 for instance e1ac17a6-46c5-4217-bfc1-b592f3ddd132 on hv-cinder-81080 Sep 24 03:36:25.761343 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-cfee35d8-64ec-4b20-bf69-617791cfed75 req-013b1b37-c878-4b55-a14b-125d13f28627 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031871 Sep 24 03:36:25.761996 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 395/803] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:36:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:36:26.746281 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8db98372-dbd7-44e9-bc75-fc2eca3f22ef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:26.747118 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8db98372-dbd7-44e9-bc75-fc2eca3f22ef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:26.753964 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8db98372-dbd7-44e9-bc75-fc2eca3f22ef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:26.754480 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8db98372-dbd7-44e9-bc75-fc2eca3f22ef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:26.755076 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6a68d88a-2921-4fa6-8cf3-c342d7b62499 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:26.755543 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8db98372-dbd7-44e9-bc75-fc2eca3f22ef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:26.755869 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8db98372-dbd7-44e9-bc75-fc2eca3f22ef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:26.756082 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6a68d88a-2921-4fa6-8cf3-c342d7b62499 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:26.762636 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6a68d88a-2921-4fa6-8cf3-c342d7b62499 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:26.762852 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6a68d88a-2921-4fa6-8cf3-c342d7b62499 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:26.763614 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6a68d88a-2921-4fa6-8cf3-c342d7b62499 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:26.764045 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6a68d88a-2921-4fa6-8cf3-c342d7b62499 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:26.852765 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6a68d88a-2921-4fa6-8cf3-c342d7b62499 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 23802 microversion: 2.20 time: 0.101322 Sep 24 03:36:26.853426 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 396/804] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:26 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 23802 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:26.860222 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a99c28fc-c443-4f9e-87c0-76639601f758 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:26.860812 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a99c28fc-c443-4f9e-87c0-76639601f758 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:26.867981 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a99c28fc-c443-4f9e-87c0-76639601f758 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:26.868504 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a99c28fc-c443-4f9e-87c0-76639601f758 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:26.869286 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a99c28fc-c443-4f9e-87c0-76639601f758 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:26.869814 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a99c28fc-c443-4f9e-87c0-76639601f758 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:26.893943 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8db98372-dbd7-44e9-bc75-fc2eca3f22ef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:26.902035 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8db98372-dbd7-44e9-bc75-fc2eca3f22ef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1362 microversion: 2.1 time: 0.161036 Sep 24 03:36:26.905795 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 409/805] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:26 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:26.971049 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-a99c28fc-c443-4f9e-87c0-76639601f758 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lazy-loading 'services' on Instance uuid 9b2947b8-8c83-4cef-986b-fc6f1c5d0638 {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:36:27.041350 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a99c28fc-c443-4f9e-87c0-76639601f758 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638/os-volume_attachments/626d68e4-5f5a-4e27-91be-fd7016687df4" status: 202 len: 0 microversion: 2.1 time: 0.186195 Sep 24 03:36:27.042045 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 397/806] 10.222.0.18 () {58 vars in 1416 bytes} [Fri Sep 24 03:36:26 2021] DELETE /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638/os-volume_attachments/626d68e4-5f5a-4e27-91be-fd7016687df4 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:27.864293 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-39632410-9dff-47a6-874f-d26159d5a480 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:27.865327 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-39632410-9dff-47a6-874f-d26159d5a480 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:27.872501 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-39632410-9dff-47a6-874f-d26159d5a480 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:27.872948 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-39632410-9dff-47a6-874f-d26159d5a480 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:27.873737 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-39632410-9dff-47a6-874f-d26159d5a480 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:27.874176 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-39632410-9dff-47a6-874f-d26159d5a480 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:27.920128 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6917a99c-f19a-4e92-b2d2-8401e8a1349c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:27.920815 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6917a99c-f19a-4e92-b2d2-8401e8a1349c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:27.926962 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6917a99c-f19a-4e92-b2d2-8401e8a1349c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:27.927406 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6917a99c-f19a-4e92-b2d2-8401e8a1349c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:27.928156 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6917a99c-f19a-4e92-b2d2-8401e8a1349c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:27.928598 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6917a99c-f19a-4e92-b2d2-8401e8a1349c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:28.053099 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6917a99c-f19a-4e92-b2d2-8401e8a1349c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:28.061453 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6917a99c-f19a-4e92-b2d2-8401e8a1349c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1547 microversion: 2.1 time: 0.145819 Sep 24 03:36:28.062051 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 398/807] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:27 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:28.078110 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6fff146f-8d4f-4b31-9b29-fe364be369c5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:28.078595 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6fff146f-8d4f-4b31-9b29-fe364be369c5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:28.084720 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6fff146f-8d4f-4b31-9b29-fe364be369c5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:28.085164 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6fff146f-8d4f-4b31-9b29-fe364be369c5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:28.086119 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6fff146f-8d4f-4b31-9b29-fe364be369c5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:28.086433 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6fff146f-8d4f-4b31-9b29-fe364be369c5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:28.174982 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6fff146f-8d4f-4b31-9b29-fe364be369c5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100381 Sep 24 03:36:28.175725 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 399/808] 10.222.0.18 () {58 vars in 1275 bytes} [Fri Sep 24 03:36:28 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:36:28.803701 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-39632410-9dff-47a6-874f-d26159d5a480 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 25843 microversion: 2.20 time: 0.943320 Sep 24 03:36:28.805158 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 410/809] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:27 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 25843 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:29.122878 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-fc430dab-bd08-425e-b82b-e20b404ec142 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:29.123846 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-fc430dab-bd08-425e-b82b-e20b404ec142 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:29.130937 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-2ceb4c09-a5d9-47f1-828e-a0fc91b9dafb req-36ff6cb3-a9c8-4467-aff7-da128c0321c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ac17a6-46c5-4217-bfc1-b592f3ddd132", "tag": "2a9f0597-3e1c-4f71-8e1d-3016b73e3e60"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:29.132419 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:36:29.132419 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:36:29.139672 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fc430dab-bd08-425e-b82b-e20b404ec142 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:29.140343 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fc430dab-bd08-425e-b82b-e20b404ec142 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:29.141190 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fc430dab-bd08-425e-b82b-e20b404ec142 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:29.141367 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-2ceb4c09-a5d9-47f1-828e-a0fc91b9dafb req-36ff6cb3-a9c8-4467-aff7-da128c0321c2 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:29.141792 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fc430dab-bd08-425e-b82b-e20b404ec142 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:29.142024 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-2ceb4c09-a5d9-47f1-828e-a0fc91b9dafb req-36ff6cb3-a9c8-4467-aff7-da128c0321c2 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:29.154016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-2ceb4c09-a5d9-47f1-828e-a0fc91b9dafb req-36ff6cb3-a9c8-4467-aff7-da128c0321c2 service nova] Creating event network-changed:2a9f0597-3e1c-4f71-8e1d-3016b73e3e60 for instance e1ac17a6-46c5-4217-bfc1-b592f3ddd132 on hv-cinder-81080 Sep 24 03:36:29.159078 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-2ceb4c09-a5d9-47f1-828e-a0fc91b9dafb req-36ff6cb3-a9c8-4467-aff7-da128c0321c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032196 Sep 24 03:36:29.159698 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 411/810] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:36:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:36:29.217779 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-fc430dab-bd08-425e-b82b-e20b404ec142 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 14 microversion: 2.1 time: 0.098166 Sep 24 03:36:29.221040 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 400/811] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:29 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:36:29.818828 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-603be763-16f6-4e47-942a-b6dc1a9e209f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:29.821541 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-603be763-16f6-4e47-942a-b6dc1a9e209f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:29.830581 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-603be763-16f6-4e47-942a-b6dc1a9e209f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:29.831335 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-603be763-16f6-4e47-942a-b6dc1a9e209f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:29.832134 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-603be763-16f6-4e47-942a-b6dc1a9e209f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:29.832558 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-603be763-16f6-4e47-942a-b6dc1a9e209f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:29.933181 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-603be763-16f6-4e47-942a-b6dc1a9e209f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 26499 microversion: 2.20 time: 0.120142 Sep 24 03:36:29.934632 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 412/812] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:29 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 26499 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:30.230111 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9de15459-2d63-4fc0-9c29-52aaee2f243f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:30.231112 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9de15459-2d63-4fc0-9c29-52aaee2f243f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:30.237961 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9de15459-2d63-4fc0-9c29-52aaee2f243f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:30.238459 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9de15459-2d63-4fc0-9c29-52aaee2f243f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:30.239244 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9de15459-2d63-4fc0-9c29-52aaee2f243f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:30.239674 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9de15459-2d63-4fc0-9c29-52aaee2f243f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:30.313365 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9de15459-2d63-4fc0-9c29-52aaee2f243f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 14 microversion: 2.1 time: 0.088248 Sep 24 03:36:30.314072 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 401/813] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:30 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:36:30.945756 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-393fdbae-c9d0-4d26-bded-1843e1536d8e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:30.946518 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-393fdbae-c9d0-4d26-bded-1843e1536d8e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:30.953018 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-393fdbae-c9d0-4d26-bded-1843e1536d8e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:30.953479 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-393fdbae-c9d0-4d26-bded-1843e1536d8e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:30.954261 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-393fdbae-c9d0-4d26-bded-1843e1536d8e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:30.954699 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-393fdbae-c9d0-4d26-bded-1843e1536d8e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:31.040599 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-393fdbae-c9d0-4d26-bded-1843e1536d8e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 27126 microversion: 2.20 time: 0.099079 Sep 24 03:36:31.041282 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 413/814] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:30 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 27126 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:31.324278 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-9f92b690-dcbf-416e-8c41-8c269f68947c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:31.325263 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-9f92b690-dcbf-416e-8c41-8c269f68947c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:31.331665 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9f92b690-dcbf-416e-8c41-8c269f68947c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:31.331997 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9f92b690-dcbf-416e-8c41-8c269f68947c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:31.332879 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9f92b690-dcbf-416e-8c41-8c269f68947c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:31.333310 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-9f92b690-dcbf-416e-8c41-8c269f68947c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:31.398695 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-9f92b690-dcbf-416e-8c41-8c269f68947c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 14 microversion: 2.1 time: 0.077608 Sep 24 03:36:31.399378 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 402/815] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:31 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:36:32.052327 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5b309a27-0b47-419d-b73a-e6e5581fa94e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:32.053451 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5b309a27-0b47-419d-b73a-e6e5581fa94e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:32.059912 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5b309a27-0b47-419d-b73a-e6e5581fa94e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:32.060354 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5b309a27-0b47-419d-b73a-e6e5581fa94e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:32.061120 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5b309a27-0b47-419d-b73a-e6e5581fa94e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:32.061546 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5b309a27-0b47-419d-b73a-e6e5581fa94e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:32.138899 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5b309a27-0b47-419d-b73a-e6e5581fa94e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 27633 microversion: 2.20 time: 0.090371 Sep 24 03:36:32.139560 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 414/816] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:32 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 27633 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:32.409294 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-145caf67-c91e-41a8-82ef-1cb861ec6e20 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:32.410358 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-145caf67-c91e-41a8-82ef-1cb861ec6e20 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:32.418257 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-145caf67-c91e-41a8-82ef-1cb861ec6e20 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:32.418793 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-145caf67-c91e-41a8-82ef-1cb861ec6e20 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:32.419642 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-145caf67-c91e-41a8-82ef-1cb861ec6e20 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:32.420311 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-145caf67-c91e-41a8-82ef-1cb861ec6e20 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:32.489264 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-145caf67-c91e-41a8-82ef-1cb861ec6e20 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 14 microversion: 2.1 time: 0.084184 Sep 24 03:36:32.489912 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 403/817] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:32 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:36:33.150583 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-febd5442-16ff-4134-9b16-12613a5ec1a4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:33.151565 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-febd5442-16ff-4134-9b16-12613a5ec1a4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:33.157977 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-febd5442-16ff-4134-9b16-12613a5ec1a4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:33.158401 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-febd5442-16ff-4134-9b16-12613a5ec1a4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:33.159150 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-febd5442-16ff-4134-9b16-12613a5ec1a4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:33.159573 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-febd5442-16ff-4134-9b16-12613a5ec1a4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:33.242586 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-febd5442-16ff-4134-9b16-12613a5ec1a4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 27820 microversion: 2.20 time: 0.095774 Sep 24 03:36:33.243778 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 415/818] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:33 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 27820 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:33.502117 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-145e0ca8-3dc6-4ec5-9848-c5fd39b74b15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:33.503172 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-145e0ca8-3dc6-4ec5-9848-c5fd39b74b15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:33.509701 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-145e0ca8-3dc6-4ec5-9848-c5fd39b74b15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:33.510171 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-145e0ca8-3dc6-4ec5-9848-c5fd39b74b15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:33.510935 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-145e0ca8-3dc6-4ec5-9848-c5fd39b74b15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:33.511358 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-145e0ca8-3dc6-4ec5-9848-c5fd39b74b15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:33.576622 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-145e0ca8-3dc6-4ec5-9848-c5fd39b74b15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 14 microversion: 2.1 time: 0.079570 Sep 24 03:36:33.577951 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 404/819] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:33 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:36:34.255312 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-079b9153-386e-4542-930b-31242a03438a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:34.256313 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-079b9153-386e-4542-930b-31242a03438a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:34.263302 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-079b9153-386e-4542-930b-31242a03438a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:34.263743 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-079b9153-386e-4542-930b-31242a03438a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:34.264500 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-079b9153-386e-4542-930b-31242a03438a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:34.264922 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-079b9153-386e-4542-930b-31242a03438a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:34.588875 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-4d64d005-8304-4dde-bbf3-b55f5c64289d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:34.589875 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-4d64d005-8304-4dde-bbf3-b55f5c64289d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:34.596276 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4d64d005-8304-4dde-bbf3-b55f5c64289d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:34.596716 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4d64d005-8304-4dde-bbf3-b55f5c64289d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:34.597466 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4d64d005-8304-4dde-bbf3-b55f5c64289d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:34.597921 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4d64d005-8304-4dde-bbf3-b55f5c64289d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:37.002778 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-4d64d005-8304-4dde-bbf3-b55f5c64289d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 14 microversion: 2.1 time: 2.418586 Sep 24 03:36:37.003554 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 405/820] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:34 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 14 bytes in 2420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 03:36:37.027139 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-079b9153-386e-4542-930b-31242a03438a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 28178 microversion: 2.20 time: 2.775667 Sep 24 03:36:37.027987 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 416/821] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:34 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 28178 bytes in 2778 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:37.253439 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e6db29c7-468a-4f38-a0bb-8c2b0729a76f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-544611027"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:37.254069 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e6db29c7-468a-4f38-a0bb-8c2b0729a76f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:37.261078 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e6db29c7-468a-4f38-a0bb-8c2b0729a76f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:37.261513 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e6db29c7-468a-4f38-a0bb-8c2b0729a76f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:37.262297 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e6db29c7-468a-4f38-a0bb-8c2b0729a76f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:37.262722 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e6db29c7-468a-4f38-a0bb-8c2b0729a76f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:37.378980 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.network.security_group_api [None req-e6db29c7-468a-4f38-a0bb-8c2b0729a76f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Removing security group c3b936ff-f3a7-430e-bd2d-055c78a4b061 from port e6ac50dd-759d-45ec-baea-edee8c9c243d Sep 24 03:36:37.714988 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e6db29c7-468a-4f38-a0bb-8c2b0729a76f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "POST /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/action" status: 202 len: 0 microversion: 2.1 time: 0.465596 Sep 24 03:36:37.716198 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 406/822] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:37 2021] POST /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:37.783336 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6767bee8-8e3c-4bd6-b936-b20d27ba261f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:37.783837 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6767bee8-8e3c-4bd6-b936-b20d27ba261f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:37.790111 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6767bee8-8e3c-4bd6-b936-b20d27ba261f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:37.790553 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6767bee8-8e3c-4bd6-b936-b20d27ba261f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:37.791931 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6767bee8-8e3c-4bd6-b936-b20d27ba261f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:37.792356 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6767bee8-8e3c-4bd6-b936-b20d27ba261f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:37.849685 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6767bee8-8e3c-4bd6-b936-b20d27ba261f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Going to try to terminate instance {{(pid=109375) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:36:37.897565 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-3df82a96-45f2-415d-b1f8-af28ff7e10fc req-bf1bd6ab-09ef-4f84-bf43-cf30386548fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f970df3c-ce7a-4c9c-9564-0a3707e53696", "tag": "e6ac50dd-759d-45ec-baea-edee8c9c243d"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:37.899101 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:36:37.899101 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:36:37.918547 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-3df82a96-45f2-415d-b1f8-af28ff7e10fc req-bf1bd6ab-09ef-4f84-bf43-cf30386548fd service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:37.918990 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-3df82a96-45f2-415d-b1f8-af28ff7e10fc req-bf1bd6ab-09ef-4f84-bf43-cf30386548fd service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:37.962792 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6767bee8-8e3c-4bd6-b936-b20d27ba261f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 204 len: 0 microversion: 2.1 time: 0.182760 Sep 24 03:36:37.964376 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-3df82a96-45f2-415d-b1f8-af28ff7e10fc req-bf1bd6ab-09ef-4f84-bf43-cf30386548fd service nova] Creating event network-changed:e6ac50dd-759d-45ec-baea-edee8c9c243d for instance f970df3c-ce7a-4c9c-9564-0a3707e53696 on hv-cinder-81080 Sep 24 03:36:37.965794 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 407/823] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:36:37 2021] DELETE /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:36:37.971780 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-3df82a96-45f2-415d-b1f8-af28ff7e10fc req-bf1bd6ab-09ef-4f84-bf43-cf30386548fd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250986 Sep 24 03:36:37.972894 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 417/824] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:36:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:36:37.974081 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2f4859b9-2da6-40b0-8e7b-9b90d6c4b023 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:37.974979 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2f4859b9-2da6-40b0-8e7b-9b90d6c4b023 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:37.984410 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2f4859b9-2da6-40b0-8e7b-9b90d6c4b023 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:37.984840 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2f4859b9-2da6-40b0-8e7b-9b90d6c4b023 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:37.985797 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2f4859b9-2da6-40b0-8e7b-9b90d6c4b023 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:37.986495 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2f4859b9-2da6-40b0-8e7b-9b90d6c4b023 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:38.016384 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e20ad97e-61f2-47c9-b285-ed351cb36b06 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:38.017392 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e20ad97e-61f2-47c9-b285-ed351cb36b06 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:38.029312 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e20ad97e-61f2-47c9-b285-ed351cb36b06 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:38.029933 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e20ad97e-61f2-47c9-b285-ed351cb36b06 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:38.034773 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e20ad97e-61f2-47c9-b285-ed351cb36b06 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:38.035325 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e20ad97e-61f2-47c9-b285-ed351cb36b06 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:38.118111 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e20ad97e-61f2-47c9-b285-ed351cb36b06 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 14 microversion: 2.1 time: 0.107640 Sep 24 03:36:38.119677 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 418/825] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:38 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:36:38.126508 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-dfaebf8e-3429-416e-8577-d7daa7fb3a58 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:38.127737 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-dfaebf8e-3429-416e-8577-d7daa7fb3a58 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:38.136060 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dfaebf8e-3429-416e-8577-d7daa7fb3a58 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:38.136651 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dfaebf8e-3429-416e-8577-d7daa7fb3a58 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:38.137632 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dfaebf8e-3429-416e-8577-d7daa7fb3a58 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:38.138436 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dfaebf8e-3429-416e-8577-d7daa7fb3a58 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:38.212532 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-dfaebf8e-3429-416e-8577-d7daa7fb3a58 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 28178 microversion: 2.20 time: 0.091039 Sep 24 03:36:38.214742 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 419/826] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:38 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 28178 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:38.295239 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2f4859b9-2da6-40b0-8e7b-9b90d6c4b023 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:38.304430 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2f4859b9-2da6-40b0-8e7b-9b90d6c4b023 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 200 len: 1513 microversion: 2.1 time: 0.334658 Sep 24 03:36:38.305215 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 408/827] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:37 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 1513 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:39.129816 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b898f0e2-01b2-46e9-a00f-b542a5da1467 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:39.130806 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b898f0e2-01b2-46e9-a00f-b542a5da1467 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:39.137204 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b898f0e2-01b2-46e9-a00f-b542a5da1467 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:39.137642 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b898f0e2-01b2-46e9-a00f-b542a5da1467 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:39.138419 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b898f0e2-01b2-46e9-a00f-b542a5da1467 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:39.138841 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b898f0e2-01b2-46e9-a00f-b542a5da1467 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:39.208725 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b898f0e2-01b2-46e9-a00f-b542a5da1467 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 14 microversion: 2.1 time: 0.082577 Sep 24 03:36:39.211877 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 420/828] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:39 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:36:39.224375 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d5eac800-2635-4d46-8d88-7eefe65d0683 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:39.225599 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d5eac800-2635-4d46-8d88-7eefe65d0683 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:39.232122 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d5eac800-2635-4d46-8d88-7eefe65d0683 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:39.232610 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d5eac800-2635-4d46-8d88-7eefe65d0683 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:39.233376 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d5eac800-2635-4d46-8d88-7eefe65d0683 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:39.233836 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d5eac800-2635-4d46-8d88-7eefe65d0683 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:39.323203 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d5eac800-2635-4d46-8d88-7eefe65d0683 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 28178 microversion: 2.20 time: 0.101850 Sep 24 03:36:39.324103 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 409/829] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:39 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 28178 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:39.327151 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a54532e4-aa31-4008-ad57-782b339876ef tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:39.327913 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a54532e4-aa31-4008-ad57-782b339876ef tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:39.334357 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a54532e4-aa31-4008-ad57-782b339876ef tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:39.334800 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a54532e4-aa31-4008-ad57-782b339876ef tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:39.335564 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a54532e4-aa31-4008-ad57-782b339876ef tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:39.335989 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a54532e4-aa31-4008-ad57-782b339876ef tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:39.554637 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a54532e4-aa31-4008-ad57-782b339876ef tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:39.563963 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a54532e4-aa31-4008-ad57-782b339876ef tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 200 len: 1513 microversion: 2.1 time: 0.244169 Sep 24 03:36:39.573863 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 421/830] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:39 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:39.586924 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-51596c08-b8e2-42c1-af77-d0d25630cf7f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:39.588178 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-51596c08-b8e2-42c1-af77-d0d25630cf7f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:39.598188 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-51596c08-b8e2-42c1-af77-d0d25630cf7f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:39.600489 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-51596c08-b8e2-42c1-af77-d0d25630cf7f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:39.600489 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-51596c08-b8e2-42c1-af77-d0d25630cf7f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:39.600489 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-51596c08-b8e2-42c1-af77-d0d25630cf7f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:39.695009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-51596c08-b8e2-42c1-af77-d0d25630cf7f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lazy-loading 'services' on Instance uuid f970df3c-ce7a-4c9c-9564-0a3707e53696 {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:36:39.772225 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-51596c08-b8e2-42c1-af77-d0d25630cf7f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/os-volume_attachments/2106e2e4-3d95-4402-9720-cf1b0d74085a" status: 202 len: 0 microversion: 2.1 time: 0.189323 Sep 24 03:36:39.773047 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 410/831] 10.222.0.18 () {58 vars in 1416 bytes} [Fri Sep 24 03:36:39 2021] DELETE /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/os-volume_attachments/2106e2e4-3d95-4402-9720-cf1b0d74085a => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:39.782038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-59273a7c-9084-4eb2-80d3-9b2a52138dd2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:39.783220 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-59273a7c-9084-4eb2-80d3-9b2a52138dd2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:39.789419 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-59273a7c-9084-4eb2-80d3-9b2a52138dd2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:39.789969 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-59273a7c-9084-4eb2-80d3-9b2a52138dd2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:39.790766 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-59273a7c-9084-4eb2-80d3-9b2a52138dd2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:39.791398 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-59273a7c-9084-4eb2-80d3-9b2a52138dd2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:39.820598 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-59273a7c-9084-4eb2-80d3-9b2a52138dd2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042202 Sep 24 03:36:39.821161 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 422/832] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:36:39 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:36:40.001440 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-2a8f3f78-1678-4824-a514-0bf0cdc4f603 req-52c262fd-51b0-4bb7-addb-2d3696cc784d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f970df3c-ce7a-4c9c-9564-0a3707e53696", "tag": "e6ac50dd-759d-45ec-baea-edee8c9c243d"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:40.003749 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:36:40.003749 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:36:40.015510 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-2a8f3f78-1678-4824-a514-0bf0cdc4f603 req-52c262fd-51b0-4bb7-addb-2d3696cc784d service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:40.015947 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-2a8f3f78-1678-4824-a514-0bf0cdc4f603 req-52c262fd-51b0-4bb7-addb-2d3696cc784d service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:40.030921 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-2a8f3f78-1678-4824-a514-0bf0cdc4f603 req-52c262fd-51b0-4bb7-addb-2d3696cc784d service nova] Creating event network-changed:e6ac50dd-759d-45ec-baea-edee8c9c243d for instance f970df3c-ce7a-4c9c-9564-0a3707e53696 on hv-cinder-81080 Sep 24 03:36:40.035880 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-2a8f3f78-1678-4824-a514-0bf0cdc4f603 req-52c262fd-51b0-4bb7-addb-2d3696cc784d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038451 Sep 24 03:36:40.036703 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 411/833] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:36:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:36:40.219548 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-92deedfb-49ec-4b14-ab0c-9b037829f86a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:40.220491 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-92deedfb-49ec-4b14-ab0c-9b037829f86a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:40.226717 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-92deedfb-49ec-4b14-ab0c-9b037829f86a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:40.227161 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-92deedfb-49ec-4b14-ab0c-9b037829f86a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:40.227927 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-92deedfb-49ec-4b14-ab0c-9b037829f86a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:40.228422 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-92deedfb-49ec-4b14-ab0c-9b037829f86a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:40.312531 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-92deedfb-49ec-4b14-ab0c-9b037829f86a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 14 microversion: 2.1 time: 0.096464 Sep 24 03:36:40.313543 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 423/834] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:40 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:36:40.445585 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-86f0a26c-6ee0-4d6b-9899-7f511630c071 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:40.447459 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-86f0a26c-6ee0-4d6b-9899-7f511630c071 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:40.453948 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-86f0a26c-6ee0-4d6b-9899-7f511630c071 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:40.454414 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-86f0a26c-6ee0-4d6b-9899-7f511630c071 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:40.455185 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-86f0a26c-6ee0-4d6b-9899-7f511630c071 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:40.455628 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-86f0a26c-6ee0-4d6b-9899-7f511630c071 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:40.547806 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-86f0a26c-6ee0-4d6b-9899-7f511630c071 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 28179 microversion: 2.20 time: 0.217130 Sep 24 03:36:40.548812 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 412/835] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:40 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 28179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:40.582228 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-334388e4-3bfe-49b1-98b6-7ab9ad6b257a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:40.582965 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-334388e4-3bfe-49b1-98b6-7ab9ad6b257a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:40.595225 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-334388e4-3bfe-49b1-98b6-7ab9ad6b257a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:40.595995 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-334388e4-3bfe-49b1-98b6-7ab9ad6b257a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:40.598334 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-334388e4-3bfe-49b1-98b6-7ab9ad6b257a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:40.599882 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-334388e4-3bfe-49b1-98b6-7ab9ad6b257a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:40.835156 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-273e3db7-9e11-4173-9dc9-0c075ad527c8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:40.836183 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-273e3db7-9e11-4173-9dc9-0c075ad527c8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:40.845195 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-273e3db7-9e11-4173-9dc9-0c075ad527c8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:40.845911 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-273e3db7-9e11-4173-9dc9-0c075ad527c8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:40.847108 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-273e3db7-9e11-4173-9dc9-0c075ad527c8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:40.847549 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-273e3db7-9e11-4173-9dc9-0c075ad527c8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:40.884718 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-273e3db7-9e11-4173-9dc9-0c075ad527c8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053565 Sep 24 03:36:40.891275 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 413/836] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:36:40 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:36:40.897871 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e275054a-2e2a-448a-8dd9-290e4d5d704f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:40.902746 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e275054a-2e2a-448a-8dd9-290e4d5d704f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:40.910139 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e275054a-2e2a-448a-8dd9-290e4d5d704f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:40.911316 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e275054a-2e2a-448a-8dd9-290e4d5d704f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:40.913080 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e275054a-2e2a-448a-8dd9-290e4d5d704f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:40.913739 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e275054a-2e2a-448a-8dd9-290e4d5d704f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:40.996732 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-334388e4-3bfe-49b1-98b6-7ab9ad6b257a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:41.010710 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-334388e4-3bfe-49b1-98b6-7ab9ad6b257a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 200 len: 1513 microversion: 2.1 time: 0.431136 Sep 24 03:36:41.014962 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-e275054a-2e2a-448a-8dd9-290e4d5d704f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] HTTP exception thrown: Instance f970df3c-ce7a-4c9c-9564-0a3707e53696 is not attached to volume 2106e2e4-3d95-4402-9720-cf1b0d74085a Sep 24 03:36:41.016513 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e275054a-2e2a-448a-8dd9-290e4d5d704f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Returning 404 to user: Instance f970df3c-ce7a-4c9c-9564-0a3707e53696 is not attached to volume 2106e2e4-3d95-4402-9720-cf1b0d74085a {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:36:41.017589 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e275054a-2e2a-448a-8dd9-290e4d5d704f tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/os-volume_attachments/2106e2e4-3d95-4402-9720-cf1b0d74085a" status: 404 len: 154 microversion: 2.1 time: 0.125006 Sep 24 03:36:41.018257 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 414/837] 10.222.0.18 () {58 vars in 1416 bytes} [Fri Sep 24 03:36:40 2021] DELETE /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696/os-volume_attachments/2106e2e4-3d95-4402-9720-cf1b0d74085a => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:36:41.023474 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 424/838] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:40 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 1513 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:41.324715 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5f973c80-3cbd-47d0-a520-ed03ddabcbac tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:41.325627 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5f973c80-3cbd-47d0-a520-ed03ddabcbac tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:41.331910 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5f973c80-3cbd-47d0-a520-ed03ddabcbac tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:41.332343 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5f973c80-3cbd-47d0-a520-ed03ddabcbac tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:41.333378 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5f973c80-3cbd-47d0-a520-ed03ddabcbac tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:41.333810 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5f973c80-3cbd-47d0-a520-ed03ddabcbac tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:41.405223 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5f973c80-3cbd-47d0-a520-ed03ddabcbac tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 14 microversion: 2.1 time: 0.084769 Sep 24 03:36:41.408934 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 415/839] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:41 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 03:36:41.560488 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b06258cb-9389-4959-9da5-5de915d235b6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:41.561436 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b06258cb-9389-4959-9da5-5de915d235b6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:41.567191 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b06258cb-9389-4959-9da5-5de915d235b6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:41.567635 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b06258cb-9389-4959-9da5-5de915d235b6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:41.568401 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b06258cb-9389-4959-9da5-5de915d235b6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:41.568829 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b06258cb-9389-4959-9da5-5de915d235b6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:41.647971 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b06258cb-9389-4959-9da5-5de915d235b6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 28469 microversion: 2.20 time: 0.091676 Sep 24 03:36:41.648539 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 425/840] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:41 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 28469 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:42.029978 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1ebb1196-1277-40f7-9564-21b8a0691b37 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:42.030678 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1ebb1196-1277-40f7-9564-21b8a0691b37 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 9b2947b8-8c83-4cef-986b-fc6f1c5d0638] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:42.037169 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1ebb1196-1277-40f7-9564-21b8a0691b37 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:42.037618 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1ebb1196-1277-40f7-9564-21b8a0691b37 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:42.038445 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1ebb1196-1277-40f7-9564-21b8a0691b37 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:42.038878 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1ebb1196-1277-40f7-9564-21b8a0691b37 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:42.052230 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-4d39413a-64e6-4bb3-96ca-741f505c7870 req-fc058805-74b7-4fbd-b05c-ef6016829ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2947b8-8c83-4cef-986b-fc6f1c5d0638", "name": "network-vif-deleted", "tag": "cf89626a-0edc-4473-b110-62d1dceec972"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:42.052776 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-1ebb1196-1277-40f7-9564-21b8a0691b37 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] HTTP exception thrown: Instance 9b2947b8-8c83-4cef-986b-fc6f1c5d0638 could not be found. Sep 24 03:36:42.053428 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1ebb1196-1277-40f7-9564-21b8a0691b37 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Returning 404 to user: Instance 9b2947b8-8c83-4cef-986b-fc6f1c5d0638 could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:36:42.053906 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:36:42.053906 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:36:42.054289 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1ebb1196-1277-40f7-9564-21b8a0691b37 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638" status: 404 len: 111 microversion: 2.1 time: 0.028388 Sep 24 03:36:42.054842 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 416/841] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:42 2021] GET /compute/v2.1/servers/9b2947b8-8c83-4cef-986b-fc6f1c5d0638 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:36:42.062478 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-4d39413a-64e6-4bb3-96ca-741f505c7870 req-fc058805-74b7-4fbd-b05c-ef6016829ab8 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:42.062937 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-4d39413a-64e6-4bb3-96ca-741f505c7870 req-fc058805-74b7-4fbd-b05c-ef6016829ab8 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:42.075081 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-4d39413a-64e6-4bb3-96ca-741f505c7870 req-fc058805-74b7-4fbd-b05c-ef6016829ab8 service nova] Creating event network-vif-deleted:cf89626a-0edc-4473-b110-62d1dceec972 for instance 9b2947b8-8c83-4cef-986b-fc6f1c5d0638 on hv-cinder-81080 Sep 24 03:36:42.079191 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-4d39413a-64e6-4bb3-96ca-741f505c7870 req-fc058805-74b7-4fbd-b05c-ef6016829ab8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030818 Sep 24 03:36:42.079776 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 426/842] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:36:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:36:42.188195 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c47fc516-104d-4a6f-b721-44ea514b6074 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:42.188693 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c47fc516-104d-4a6f-b721-44ea514b6074 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:42.198789 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c47fc516-104d-4a6f-b721-44ea514b6074 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:42.199261 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c47fc516-104d-4a6f-b721-44ea514b6074 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:42.200070 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c47fc516-104d-4a6f-b721-44ea514b6074 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:42.200501 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c47fc516-104d-4a6f-b721-44ea514b6074 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:42.226269 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c47fc516-104d-4a6f-b721-44ea514b6074 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Going to try to terminate instance {{(pid=109375) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:36:42.301339 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c47fc516-104d-4a6f-b721-44ea514b6074 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 204 len: 0 microversion: 2.1 time: 0.116814 Sep 24 03:36:42.301929 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 417/843] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:36:42 2021] DELETE /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:36:42.310903 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ced8ff46-f006-4871-87fa-2f8721d71579 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:42.311598 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ced8ff46-f006-4871-87fa-2f8721d71579 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:42.317497 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ced8ff46-f006-4871-87fa-2f8721d71579 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:42.317979 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ced8ff46-f006-4871-87fa-2f8721d71579 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:42.318739 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ced8ff46-f006-4871-87fa-2f8721d71579 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:42.319163 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ced8ff46-f006-4871-87fa-2f8721d71579 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:42.417530 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-993e9b47-e078-4a07-af98-6664dfe7ea3a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:42.419073 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-993e9b47-e078-4a07-af98-6664dfe7ea3a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:42.424843 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-993e9b47-e078-4a07-af98-6664dfe7ea3a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:42.425273 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-993e9b47-e078-4a07-af98-6664dfe7ea3a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:42.426068 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-993e9b47-e078-4a07-af98-6664dfe7ea3a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:42.426491 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-993e9b47-e078-4a07-af98-6664dfe7ea3a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:42.448045 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ced8ff46-f006-4871-87fa-2f8721d71579 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:42.455546 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ced8ff46-f006-4871-87fa-2f8721d71579 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1556 microversion: 2.1 time: 0.148689 Sep 24 03:36:42.456118 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 427/844] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:42 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:42.659661 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-36cddcb0-8c16-4c14-b0c7-1bbfface1f09 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:42.660489 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-36cddcb0-8c16-4c14-b0c7-1bbfface1f09 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:42.666874 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-36cddcb0-8c16-4c14-b0c7-1bbfface1f09 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:42.667313 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-36cddcb0-8c16-4c14-b0c7-1bbfface1f09 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:42.668085 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-36cddcb0-8c16-4c14-b0c7-1bbfface1f09 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:42.668729 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-36cddcb0-8c16-4c14-b0c7-1bbfface1f09 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:45.167915 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-993e9b47-e078-4a07-af98-6664dfe7ea3a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 14 microversion: 2.1 time: 2.754775 Sep 24 03:36:45.168515 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 418/845] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:42 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 14 bytes in 2757 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 03:36:45.173476 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1414164248", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-786959083", "security_groups": [{"name": "tempest-secgroup-smoke-1535929102"}], "networks": [{"uuid": "cc5e08ad-2e36-4c6d-b5d1-210218b7a366"}], "block_device_mapping_v2": [{"uuid": "8dbdff3e-975c-47b6-98ef-3bb15e523ede", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:45.226110 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-36cddcb0-8c16-4c14-b0c7-1bbfface1f09 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 28637 microversion: 2.20 time: 2.569910 Sep 24 03:36:45.230075 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 428/846] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:42 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 28637 bytes in 2571 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:36:45.232575 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-aa39529e-25bb-4e37-801d-ddbf1aacbee8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:45.233268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-aa39529e-25bb-4e37-801d-ddbf1aacbee8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:45.241103 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa39529e-25bb-4e37-801d-ddbf1aacbee8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:45.241547 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa39529e-25bb-4e37-801d-ddbf1aacbee8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:45.242357 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa39529e-25bb-4e37-801d-ddbf1aacbee8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:45.242787 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa39529e-25bb-4e37-801d-ddbf1aacbee8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:45.282432 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.network.neutron [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] validate_networks() for [('cc5e08ad-2e36-4c6d-b5d1-210218b7a366', None, None, None, None, None)] {{(pid=109375) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:36:45.460772 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-aa39529e-25bb-4e37-801d-ddbf1aacbee8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:45.468956 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-aa39529e-25bb-4e37-801d-ddbf1aacbee8 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1556 microversion: 2.1 time: 0.240932 Sep 24 03:36:45.469537 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 429/847] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:45 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1556 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:45.797972 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Flavor limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:36:45.798390 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Image limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:36:45.798855 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Flavor pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:36:45.799257 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Image pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:36:45.799658 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:36:45.808960 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:45.809400 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:45.810233 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:45.810659 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:45.826493 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Getting quotas for project 69c1af3d8fb24a3ea2c05a5b9d852f84. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:36:45.830374 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Getting quotas for user 37b84611e0b0496d9d5f6d24d180b567 and project 69c1af3d8fb24a3ea2c05a5b9d852f84. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:36:45.889178 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Going to run 1 instances... {{(pid=109375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:36:45.891497 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8dbdff3e-975c-47b6-98ef-3bb15e523ede',volume_size=None,volume_type=None)] {{(pid=109375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:36:46.015766 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f878a431-f92b-49f4-b47e-d75a85a3fe9c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.845891 Sep 24 03:36:46.016417 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 419/848] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:36:45 2021] POST /compute/v2.1/servers => generated 406 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:36:46.026755 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c002c099-a03a-4bc8-a1eb-eed14e1266e1 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:46.027356 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c002c099-a03a-4bc8-a1eb-eed14e1266e1 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:46.079600 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c002c099-a03a-4bc8-a1eb-eed14e1266e1 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:46.086368 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c002c099-a03a-4bc8-a1eb-eed14e1266e1 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1088 microversion: 2.1 time: 0.063949 Sep 24 03:36:46.086965 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 430/849] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:46 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1088 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:46.177609 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-73d73928-226f-4aa1-91ce-c8f16e629e62 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:46.178612 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-73d73928-226f-4aa1-91ce-c8f16e629e62 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:46.185381 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-73d73928-226f-4aa1-91ce-c8f16e629e62 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:46.185846 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-73d73928-226f-4aa1-91ce-c8f16e629e62 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:46.186604 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-73d73928-226f-4aa1-91ce-c8f16e629e62 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:46.187022 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-73d73928-226f-4aa1-91ce-c8f16e629e62 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:46.238573 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-20f60c3e-ca76-4b8b-aa95-fe5fd406145b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:46.239729 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-20f60c3e-ca76-4b8b-aa95-fe5fd406145b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:46.247393 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-20f60c3e-ca76-4b8b-aa95-fe5fd406145b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:46.247886 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-20f60c3e-ca76-4b8b-aa95-fe5fd406145b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:46.248658 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-20f60c3e-ca76-4b8b-aa95-fe5fd406145b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:46.249091 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-20f60c3e-ca76-4b8b-aa95-fe5fd406145b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:46.261374 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-73d73928-226f-4aa1-91ce-c8f16e629e62 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 14 microversion: 2.1 time: 0.087225 Sep 24 03:36:46.264438 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 420/850] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:46 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:36:46.320710 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-20f60c3e-ca76-4b8b-aa95-fe5fd406145b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 28637 microversion: 2.20 time: 0.085991 Sep 24 03:36:46.321349 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 431/851] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:46 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 28637 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:36:46.487145 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2959ac8f-c295-40c1-aeae-8526535e00a2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:46.487830 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2959ac8f-c295-40c1-aeae-8526535e00a2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:46.495846 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2959ac8f-c295-40c1-aeae-8526535e00a2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:46.495846 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2959ac8f-c295-40c1-aeae-8526535e00a2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:46.496267 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2959ac8f-c295-40c1-aeae-8526535e00a2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:46.496700 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2959ac8f-c295-40c1-aeae-8526535e00a2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:46.624653 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2959ac8f-c295-40c1-aeae-8526535e00a2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:46.632459 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2959ac8f-c295-40c1-aeae-8526535e00a2 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1556 microversion: 2.1 time: 0.149544 Sep 24 03:36:46.633044 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 421/852] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:46 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:47.105431 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e8c1c347-1114-4f11-ac8b-3578ca169b17 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:47.106160 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e8c1c347-1114-4f11-ac8b-3578ca169b17 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:47.112931 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8c1c347-1114-4f11-ac8b-3578ca169b17 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:47.113374 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8c1c347-1114-4f11-ac8b-3578ca169b17 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:47.114164 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8c1c347-1114-4f11-ac8b-3578ca169b17 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:47.114588 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e8c1c347-1114-4f11-ac8b-3578ca169b17 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:47.204827 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e8c1c347-1114-4f11-ac8b-3578ca169b17 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:47.212444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e8c1c347-1114-4f11-ac8b-3578ca169b17 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1194 microversion: 2.1 time: 0.112170 Sep 24 03:36:47.213247 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 432/853] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:47 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1194 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:47.274480 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-7f44d01c-da51-45c9-8de3-d4b590196c85 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:47.276367 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-7f44d01c-da51-45c9-8de3-d4b590196c85 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:47.284853 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7f44d01c-da51-45c9-8de3-d4b590196c85 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:47.285377 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7f44d01c-da51-45c9-8de3-d4b590196c85 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:47.286413 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7f44d01c-da51-45c9-8de3-d4b590196c85 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:47.286920 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7f44d01c-da51-45c9-8de3-d4b590196c85 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:47.332501 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6eb4f066-64a8-4817-b471-fcb090cfed3a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:47.333927 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6eb4f066-64a8-4817-b471-fcb090cfed3a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:47.340101 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6eb4f066-64a8-4817-b471-fcb090cfed3a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:47.340538 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6eb4f066-64a8-4817-b471-fcb090cfed3a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:47.341352 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6eb4f066-64a8-4817-b471-fcb090cfed3a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:47.341843 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6eb4f066-64a8-4817-b471-fcb090cfed3a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:47.372753 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-7f44d01c-da51-45c9-8de3-d4b590196c85 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 5014 microversion: 2.1 time: 0.103821 Sep 24 03:36:47.376343 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 422/854] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:47 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 5014 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:47.420591 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6eb4f066-64a8-4817-b471-fcb090cfed3a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 28637 microversion: 2.20 time: 0.091578 Sep 24 03:36:47.424509 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 433/855] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:47 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 28637 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:36:47.654500 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5c3184bb-9b93-4412-97e8-6939a5c4c273 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:47.655232 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5c3184bb-9b93-4412-97e8-6939a5c4c273 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:47.662333 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5c3184bb-9b93-4412-97e8-6939a5c4c273 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:47.662768 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5c3184bb-9b93-4412-97e8-6939a5c4c273 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:47.667740 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5c3184bb-9b93-4412-97e8-6939a5c4c273 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:47.668646 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5c3184bb-9b93-4412-97e8-6939a5c4c273 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:48.156120 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5c3184bb-9b93-4412-97e8-6939a5c4c273 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:48.164447 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5c3184bb-9b93-4412-97e8-6939a5c4c273 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1556 microversion: 2.1 time: 0.514811 Sep 24 03:36:48.174324 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 423/856] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:47 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1556 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:48.232863 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-833a5185-2744-48cd-a38a-74eb7af28aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:48.233876 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-833a5185-2744-48cd-a38a-74eb7af28aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:48.240824 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-833a5185-2744-48cd-a38a-74eb7af28aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:48.241262 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-833a5185-2744-48cd-a38a-74eb7af28aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:48.242044 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-833a5185-2744-48cd-a38a-74eb7af28aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:48.242467 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-833a5185-2744-48cd-a38a-74eb7af28aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:48.298166 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-9f90dd12-3c2f-473f-99bc-8c5568e6476c req-59e68624-e9c9-4c90-a286-dfed3abadbad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f970df3c-ce7a-4c9c-9564-0a3707e53696", "name": "network-vif-deleted", "tag": "e6ac50dd-759d-45ec-baea-edee8c9c243d"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:48.300092 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:36:48.300092 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:36:48.308236 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-9f90dd12-3c2f-473f-99bc-8c5568e6476c req-59e68624-e9c9-4c90-a286-dfed3abadbad service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:48.308760 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-9f90dd12-3c2f-473f-99bc-8c5568e6476c req-59e68624-e9c9-4c90-a286-dfed3abadbad service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:48.319728 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-9f90dd12-3c2f-473f-99bc-8c5568e6476c req-59e68624-e9c9-4c90-a286-dfed3abadbad service nova] Creating event network-vif-deleted:e6ac50dd-759d-45ec-baea-edee8c9c243d for instance f970df3c-ce7a-4c9c-9564-0a3707e53696 on hv-cinder-81080 Sep 24 03:36:48.324680 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-9f90dd12-3c2f-473f-99bc-8c5568e6476c req-59e68624-e9c9-4c90-a286-dfed3abadbad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030416 Sep 24 03:36:48.325362 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 424/857] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:36:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:36:48.328874 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-833a5185-2744-48cd-a38a-74eb7af28aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:48.336178 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-833a5185-2744-48cd-a38a-74eb7af28aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1192 microversion: 2.1 time: 0.108752 Sep 24 03:36:48.336758 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 434/858] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:48 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1192 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:48.384597 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-fa514c94-9063-47f7-8a98-e2d78e2826dc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:48.386287 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-fa514c94-9063-47f7-8a98-e2d78e2826dc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:48.392529 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fa514c94-9063-47f7-8a98-e2d78e2826dc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:48.393019 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fa514c94-9063-47f7-8a98-e2d78e2826dc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:48.393827 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fa514c94-9063-47f7-8a98-e2d78e2826dc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:48.394258 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fa514c94-9063-47f7-8a98-e2d78e2826dc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:48.433154 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-344522be-7712-4ece-8ec8-d4bb7096620b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:48.434158 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-344522be-7712-4ece-8ec8-d4bb7096620b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:48.440189 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-344522be-7712-4ece-8ec8-d4bb7096620b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:48.440629 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-344522be-7712-4ece-8ec8-d4bb7096620b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:48.441399 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-344522be-7712-4ece-8ec8-d4bb7096620b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:48.441861 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-344522be-7712-4ece-8ec8-d4bb7096620b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:50.704853 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-344522be-7712-4ece-8ec8-d4bb7096620b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 28637 microversion: 2.20 time: 2.276266 Sep 24 03:36:50.709633 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 435/859] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:48 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 28637 bytes in 2282 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:50.715815 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b012c055-05a6-4ee8-902d-fdb7c01a57e5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:50.716647 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b012c055-05a6-4ee8-902d-fdb7c01a57e5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:50.727878 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b012c055-05a6-4ee8-902d-fdb7c01a57e5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:50.728731 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b012c055-05a6-4ee8-902d-fdb7c01a57e5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:50.730047 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b012c055-05a6-4ee8-902d-fdb7c01a57e5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:50.730726 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b012c055-05a6-4ee8-902d-fdb7c01a57e5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:50.736452 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-fa514c94-9063-47f7-8a98-e2d78e2826dc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 19342 microversion: 2.1 time: 2.354945 Sep 24 03:36:50.741206 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 425/860] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:48 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 19342 bytes in 2361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:36:50.749812 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-070fe4da-f465-4e3d-b4e9-acc4ad5e10aa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:50.750805 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-070fe4da-f465-4e3d-b4e9-acc4ad5e10aa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:50.759540 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-070fe4da-f465-4e3d-b4e9-acc4ad5e10aa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:50.760306 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-070fe4da-f465-4e3d-b4e9-acc4ad5e10aa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:50.762442 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-070fe4da-f465-4e3d-b4e9-acc4ad5e10aa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:50.763102 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b012c055-05a6-4ee8-902d-fdb7c01a57e5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:50.763543 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b012c055-05a6-4ee8-902d-fdb7c01a57e5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:50.763802 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-070fe4da-f465-4e3d-b4e9-acc4ad5e10aa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:50.763998 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.objects.instance [None req-b012c055-05a6-4ee8-902d-fdb7c01a57e5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lazy-loading 'fault' on Instance uuid f970df3c-ce7a-4c9c-9564-0a3707e53696 {{(pid=109374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:36:50.821511 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b012c055-05a6-4ee8-902d-fdb7c01a57e5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff280c7d78b4febb8ef3abe52b8f2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8aafe7ea28c45d79b2cb49f09c3c82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:50.839532 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b012c055-05a6-4ee8-902d-fdb7c01a57e5 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 200 len: 1349 microversion: 2.1 time: 0.120510 Sep 24 03:36:50.840257 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 436/861] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:50 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 1349 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:50.943064 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-777596093", "imageRef": "dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a", "flavorRef": "452", "networks": [{"uuid": "ce30542c-69af-4033-9d35-5d6651a01e27"}]}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:50.995194 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.network.neutron [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] validate_networks() for [('ce30542c-69af-4033-9d35-5d6651a01e27', None, None, None, None, None)] {{(pid=109374) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:36:51.060415 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-070fe4da-f465-4e3d-b4e9-acc4ad5e10aa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:51.068036 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-070fe4da-f465-4e3d-b4e9-acc4ad5e10aa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1260 microversion: 2.1 time: 0.325037 Sep 24 03:36:51.068529 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 426/862] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:50 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1260 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:51.640537 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Flavor limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:36:51.641490 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Image limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:36:51.642104 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Flavor pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:36:51.642673 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Image pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:36:51.643466 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:36:51.653272 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-894cc86a-a285-491a-afd4-2031972f7a4f req-d1174e2f-6875-4e6d-abf0-97a59e30d66b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a23918f-1f46-46ff-8559-df4e0d82e8d3", "tag": "0dfff50d-916c-4ef8-b736-5fe358a4016f"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:51.655114 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:36:51.655114 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:36:51.665030 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:51.665475 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:51.668076 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:51.668699 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:51.685914 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-894cc86a-a285-491a-afd4-2031972f7a4f req-d1174e2f-6875-4e6d-abf0-97a59e30d66b service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:51.686358 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-894cc86a-a285-491a-afd4-2031972f7a4f req-d1174e2f-6875-4e6d-abf0-97a59e30d66b service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:51.699480 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-894cc86a-a285-491a-afd4-2031972f7a4f req-d1174e2f-6875-4e6d-abf0-97a59e30d66b service nova] Creating event network-changed:0dfff50d-916c-4ef8-b736-5fe358a4016f for instance 8a23918f-1f46-46ff-8559-df4e0d82e8d3 on hv-cinder-81080 Sep 24 03:36:51.704523 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-894cc86a-a285-491a-afd4-2031972f7a4f req-d1174e2f-6875-4e6d-abf0-97a59e30d66b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054838 Sep 24 03:36:51.705772 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 427/863] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:36:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:36:51.709437 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Getting quotas for project f90f5ee150c84714b914726dff583040. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:36:51.714185 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Getting quotas for user 40ce35e824ae44ce8f1a9d3268fda85a and project f90f5ee150c84714b914726dff583040. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:36:51.718471 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8aa77f76-32d1-4e89-932f-1169026437e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:51.719785 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8aa77f76-32d1-4e89-932f-1169026437e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:51.726648 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8aa77f76-32d1-4e89-932f-1169026437e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:51.727763 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8aa77f76-32d1-4e89-932f-1169026437e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:51.729620 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8aa77f76-32d1-4e89-932f-1169026437e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:51.730445 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8aa77f76-32d1-4e89-932f-1169026437e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:51.731499 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Going to run 1 instances... {{(pid=109374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:36:51.734303 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd8d1d6c-c9ed-45b2-9eaf-9c9169d8e68a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=109374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:36:51.793204 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3081f821-dbb1-445e-9e63-c87a59a749c5 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853704 Sep 24 03:36:51.794480 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 437/864] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:36:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 03:36:51.799466 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-466cfb18-1102-4381-9e1b-009f3fd63850 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:51.800671 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-466cfb18-1102-4381-9e1b-009f3fd63850 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:51.807621 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-466cfb18-1102-4381-9e1b-009f3fd63850 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:51.808309 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-466cfb18-1102-4381-9e1b-009f3fd63850 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:51.809360 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-466cfb18-1102-4381-9e1b-009f3fd63850 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:51.810136 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-466cfb18-1102-4381-9e1b-009f3fd63850 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:51.812911 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8aa77f76-32d1-4e89-932f-1169026437e5 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 28637 microversion: 2.20 time: 0.099583 Sep 24 03:36:51.817280 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 428/865] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:51 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 28637 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:51.825449 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-200ce6d7-9a83-46e2-943d-53b936385583 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:51.826344 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-200ce6d7-9a83-46e2-943d-53b936385583 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:51.893591 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-466cfb18-1102-4381-9e1b-009f3fd63850 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 22015 microversion: 2.1 time: 0.097544 Sep 24 03:36:51.894444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 438/866] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:51 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 22015 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:36:51.900442 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6b20e733-6acd-4ccc-b51c-446a5678df25 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:51.902217 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6b20e733-6acd-4ccc-b51c-446a5678df25 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] [instance: f970df3c-ce7a-4c9c-9564-0a3707e53696] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:51.913390 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6b20e733-6acd-4ccc-b51c-446a5678df25 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:51.913655 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6b20e733-6acd-4ccc-b51c-446a5678df25 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:51.914519 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6b20e733-6acd-4ccc-b51c-446a5678df25 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:51.915038 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6b20e733-6acd-4ccc-b51c-446a5678df25 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:51.916109 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-200ce6d7-9a83-46e2-943d-53b936385583 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:51.924186 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-200ce6d7-9a83-46e2-943d-53b936385583 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 200 len: 1218 microversion: 2.1 time: 0.105395 Sep 24 03:36:51.925097 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 429/867] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:51 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:51.930758 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-6b20e733-6acd-4ccc-b51c-446a5678df25 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] HTTP exception thrown: Instance f970df3c-ce7a-4c9c-9564-0a3707e53696 could not be found. Sep 24 03:36:51.931884 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6b20e733-6acd-4ccc-b51c-446a5678df25 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Returning 404 to user: Instance f970df3c-ce7a-4c9c-9564-0a3707e53696 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:36:51.933509 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6b20e733-6acd-4ccc-b51c-446a5678df25 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696" status: 404 len: 111 microversion: 2.1 time: 0.037700 Sep 24 03:36:51.936693 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 439/868] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:51 2021] GET /compute/v2.1/servers/f970df3c-ce7a-4c9c-9564-0a3707e53696 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:36:51.942014 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-22d337a2-2965-4260-bf38-f67190b03f57 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] Calling method '.version_select at 0x7f666410fc10>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:51.961951 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-22d337a2-2965-4260-bf38-f67190b03f57 tempest-TestMinimumBasicScenario-2071764494 tempest-TestMinimumBasicScenario-2071764494-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1633299866" status: 202 len: 0 microversion: 2.1 time: 0.023244 Sep 24 03:36:51.979256 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 430/869] 10.222.0.18 () {58 vars in 1272 bytes} [Fri Sep 24 03:36:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1633299866 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:52.090081 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0ad5aac0-27b3-4468-9810-d08e932c03ad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:52.090960 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0ad5aac0-27b3-4468-9810-d08e932c03ad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:52.099675 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0ad5aac0-27b3-4468-9810-d08e932c03ad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:52.100741 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0ad5aac0-27b3-4468-9810-d08e932c03ad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:52.101623 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0ad5aac0-27b3-4468-9810-d08e932c03ad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:52.102850 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0ad5aac0-27b3-4468-9810-d08e932c03ad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:52.282116 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0ad5aac0-27b3-4468-9810-d08e932c03ad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:52.290195 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0ad5aac0-27b3-4468-9810-d08e932c03ad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1260 microversion: 2.1 time: 0.207644 Sep 24 03:36:52.290408 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 440/870] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:52 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:52.828831 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-fb634366-6883-4467-b6ad-361d33f368ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:52.831164 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-fb634366-6883-4467-b6ad-361d33f368ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:52.841131 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fb634366-6883-4467-b6ad-361d33f368ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:52.841567 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fb634366-6883-4467-b6ad-361d33f368ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:52.842388 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fb634366-6883-4467-b6ad-361d33f368ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:52.842809 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fb634366-6883-4467-b6ad-361d33f368ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:52.906030 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-cd58f3fe-a88d-4739-92e4-5b974caaf5d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:52.907737 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-cd58f3fe-a88d-4739-92e4-5b974caaf5d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:52.914998 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cd58f3fe-a88d-4739-92e4-5b974caaf5d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:52.915445 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cd58f3fe-a88d-4739-92e4-5b974caaf5d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:52.916885 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cd58f3fe-a88d-4739-92e4-5b974caaf5d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:52.917524 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cd58f3fe-a88d-4739-92e4-5b974caaf5d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:52.922913 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-fb634366-6883-4467-b6ad-361d33f368ff tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 28971 microversion: 2.20 time: 0.100850 Sep 24 03:36:52.923761 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 431/871] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:52 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 28971 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:52.942553 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-39b8e05d-2e92-49ad-a5a5-e35a085981b4 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:52.943354 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-39b8e05d-2e92-49ad-a5a5-e35a085981b4 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:52.953736 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-39b8e05d-2e92-49ad-a5a5-e35a085981b4 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:52.954535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-39b8e05d-2e92-49ad-a5a5-e35a085981b4 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:52.955328 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-39b8e05d-2e92-49ad-a5a5-e35a085981b4 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:52.955932 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-39b8e05d-2e92-49ad-a5a5-e35a085981b4 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:52.999923 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-cd58f3fe-a88d-4739-92e4-5b974caaf5d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 23229 microversion: 2.1 time: 0.099000 Sep 24 03:36:53.001091 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 441/872] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:52 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 23229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:36:53.059777 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-39b8e05d-2e92-49ad-a5a5-e35a085981b4 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:53.069982 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-39b8e05d-2e92-49ad-a5a5-e35a085981b4 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 200 len: 1278 microversion: 2.1 time: 0.131589 Sep 24 03:36:53.071395 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 432/873] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:52 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 1278 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:53.307774 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-56486232-ac4b-49d5-a2fa-840de7f957ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:53.308462 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-56486232-ac4b-49d5-a2fa-840de7f957ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:53.315685 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-56486232-ac4b-49d5-a2fa-840de7f957ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:53.316890 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-56486232-ac4b-49d5-a2fa-840de7f957ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:53.317673 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-56486232-ac4b-49d5-a2fa-840de7f957ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:53.318130 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-56486232-ac4b-49d5-a2fa-840de7f957ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:53.538470 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-56486232-ac4b-49d5-a2fa-840de7f957ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:53.546714 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-56486232-ac4b-49d5-a2fa-840de7f957ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1260 microversion: 2.1 time: 0.243660 Sep 24 03:36:53.547289 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 442/874] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:53 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:53.936820 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-0362eb95-ffa6-4149-9994-14f534a54f5c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:53.937738 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-0362eb95-ffa6-4149-9994-14f534a54f5c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:53.943772 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0362eb95-ffa6-4149-9994-14f534a54f5c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:53.944215 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0362eb95-ffa6-4149-9994-14f534a54f5c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:53.944982 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0362eb95-ffa6-4149-9994-14f534a54f5c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:53.945411 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-0362eb95-ffa6-4149-9994-14f534a54f5c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:54.012117 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6f31f95b-8cb8-4e33-be11-57018869e073 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:54.013131 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6f31f95b-8cb8-4e33-be11-57018869e073 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:54.019253 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6f31f95b-8cb8-4e33-be11-57018869e073 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:54.019692 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6f31f95b-8cb8-4e33-be11-57018869e073 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:54.020453 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6f31f95b-8cb8-4e33-be11-57018869e073 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:54.021036 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6f31f95b-8cb8-4e33-be11-57018869e073 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:54.030289 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-0362eb95-ffa6-4149-9994-14f534a54f5c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 30881 microversion: 2.20 time: 0.098505 Sep 24 03:36:54.031952 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 433/875] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:53 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 30881 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:54.089252 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c39a5286-0dd1-4cff-8ba2-27e7e95297dc tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:54.089878 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c39a5286-0dd1-4cff-8ba2-27e7e95297dc tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:54.093499 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6f31f95b-8cb8-4e33-be11-57018869e073 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 24165 microversion: 2.1 time: 0.085158 Sep 24 03:36:54.094640 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 443/876] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:54 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 24165 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:36:54.096277 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c39a5286-0dd1-4cff-8ba2-27e7e95297dc tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:54.096717 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c39a5286-0dd1-4cff-8ba2-27e7e95297dc tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:54.097484 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c39a5286-0dd1-4cff-8ba2-27e7e95297dc tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:54.098114 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c39a5286-0dd1-4cff-8ba2-27e7e95297dc tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:54.563962 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b6f7e55c-4b08-46ec-b211-c79563328dbb tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:54.564916 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b6f7e55c-4b08-46ec-b211-c79563328dbb tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:54.571401 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b6f7e55c-4b08-46ec-b211-c79563328dbb tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:54.572059 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b6f7e55c-4b08-46ec-b211-c79563328dbb tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:54.573112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b6f7e55c-4b08-46ec-b211-c79563328dbb tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:54.573704 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b6f7e55c-4b08-46ec-b211-c79563328dbb tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:54.768513 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c39a5286-0dd1-4cff-8ba2-27e7e95297dc tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:54.777556 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c39a5286-0dd1-4cff-8ba2-27e7e95297dc tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 200 len: 1318 microversion: 2.1 time: 0.692804 Sep 24 03:36:54.778471 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 434/877] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:54 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 1318 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:54.884027 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b6f7e55c-4b08-46ec-b211-c79563328dbb tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:54.893288 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b6f7e55c-4b08-46ec-b211-c79563328dbb tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1260 microversion: 2.1 time: 0.333090 Sep 24 03:36:54.893816 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 444/878] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:54 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1260 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:55.001172 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-7621113f-3bf6-4dc9-a8ae-0fc14f71afcc req-b7ec6f9a-72a3-4c6a-8ae9-96d775b4d1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943878e5-6c60-468f-bb4b-83e2a59f5d4a", "tag": "0717861b-d1f6-493d-aa8d-5314188e7508"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:55.002697 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:36:55.002697 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:36:55.009439 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-7621113f-3bf6-4dc9-a8ae-0fc14f71afcc req-b7ec6f9a-72a3-4c6a-8ae9-96d775b4d1d7 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:55.010490 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-7621113f-3bf6-4dc9-a8ae-0fc14f71afcc req-b7ec6f9a-72a3-4c6a-8ae9-96d775b4d1d7 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:55.021479 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-7621113f-3bf6-4dc9-a8ae-0fc14f71afcc req-b7ec6f9a-72a3-4c6a-8ae9-96d775b4d1d7 service nova] Creating event network-changed:0717861b-d1f6-493d-aa8d-5314188e7508 for instance 943878e5-6c60-468f-bb4b-83e2a59f5d4a on hv-cinder-81080 Sep 24 03:36:55.026773 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-7621113f-3bf6-4dc9-a8ae-0fc14f71afcc req-b7ec6f9a-72a3-4c6a-8ae9-96d775b4d1d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028541 Sep 24 03:36:55.027268 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 435/879] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:36:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:36:55.042743 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9dd30032-6cbb-480f-bd39-1271798783db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:55.043674 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9dd30032-6cbb-480f-bd39-1271798783db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:55.049492 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9dd30032-6cbb-480f-bd39-1271798783db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:55.049967 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9dd30032-6cbb-480f-bd39-1271798783db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:55.050737 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9dd30032-6cbb-480f-bd39-1271798783db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:55.051160 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9dd30032-6cbb-480f-bd39-1271798783db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:55.105598 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2df4dab1-0adf-445b-9c3b-69fadbac3b2e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:55.106746 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2df4dab1-0adf-445b-9c3b-69fadbac3b2e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:55.113182 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2df4dab1-0adf-445b-9c3b-69fadbac3b2e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:55.113695 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2df4dab1-0adf-445b-9c3b-69fadbac3b2e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:55.114541 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2df4dab1-0adf-445b-9c3b-69fadbac3b2e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:55.115031 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2df4dab1-0adf-445b-9c3b-69fadbac3b2e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:55.130548 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9dd30032-6cbb-480f-bd39-1271798783db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 32660 microversion: 2.20 time: 0.092507 Sep 24 03:36:55.131314 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 445/880] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:55 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 32660 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:55.196559 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2df4dab1-0adf-445b-9c3b-69fadbac3b2e tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 25501 microversion: 2.1 time: 0.095275 Sep 24 03:36:55.197013 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 436/881] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:55 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 25501 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:36:55.795511 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-dccecb64-176d-48b9-bcc5-3d5600536925 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:55.796210 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-dccecb64-176d-48b9-bcc5-3d5600536925 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:55.803517 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dccecb64-176d-48b9-bcc5-3d5600536925 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:55.803965 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dccecb64-176d-48b9-bcc5-3d5600536925 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:55.804748 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dccecb64-176d-48b9-bcc5-3d5600536925 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:55.805179 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dccecb64-176d-48b9-bcc5-3d5600536925 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:55.911093 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-40197a0f-da86-48ac-9bd6-b4e2181eaca0 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:55.912312 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-40197a0f-da86-48ac-9bd6-b4e2181eaca0 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:55.921148 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-40197a0f-da86-48ac-9bd6-b4e2181eaca0 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:55.921680 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-40197a0f-da86-48ac-9bd6-b4e2181eaca0 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:55.922809 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-40197a0f-da86-48ac-9bd6-b4e2181eaca0 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:55.923333 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-40197a0f-da86-48ac-9bd6-b4e2181eaca0 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:56.049498 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-dccecb64-176d-48b9-bcc5-3d5600536925 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:56.059013 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-dccecb64-176d-48b9-bcc5-3d5600536925 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 200 len: 1318 microversion: 2.1 time: 0.267661 Sep 24 03:36:56.059915 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 446/882] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:55 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:56.142690 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2a63b344-57eb-4663-9701-211464669523 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:56.143990 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2a63b344-57eb-4663-9701-211464669523 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:56.150528 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a63b344-57eb-4663-9701-211464669523 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:56.151273 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a63b344-57eb-4663-9701-211464669523 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:56.152272 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a63b344-57eb-4663-9701-211464669523 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:56.152931 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2a63b344-57eb-4663-9701-211464669523 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:56.188739 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-40197a0f-da86-48ac-9bd6-b4e2181eaca0 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:56.198575 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-40197a0f-da86-48ac-9bd6-b4e2181eaca0 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1260 microversion: 2.1 time: 0.292336 Sep 24 03:36:56.210405 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 437/883] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:55 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1260 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:56.215648 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1f4878bd-c2c3-410c-8f1f-9b8a605689e5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:56.216557 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1f4878bd-c2c3-410c-8f1f-9b8a605689e5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:56.222319 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1f4878bd-c2c3-410c-8f1f-9b8a605689e5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:56.223027 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1f4878bd-c2c3-410c-8f1f-9b8a605689e5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:56.223803 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1f4878bd-c2c3-410c-8f1f-9b8a605689e5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:56.224234 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1f4878bd-c2c3-410c-8f1f-9b8a605689e5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:56.287517 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2a63b344-57eb-4663-9701-211464669523 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 33616 microversion: 2.20 time: 0.148449 Sep 24 03:36:56.288552 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 447/884] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:56 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 33616 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:36:56.328751 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1f4878bd-c2c3-410c-8f1f-9b8a605689e5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 26745 microversion: 2.1 time: 0.116981 Sep 24 03:36:56.329421 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 438/885] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:56 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 26745 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:36:57.075454 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0b36a3b6-9add-4f90-95f4-4f761400244f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:57.076185 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0b36a3b6-9add-4f90-95f4-4f761400244f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:57.083800 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0b36a3b6-9add-4f90-95f4-4f761400244f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:57.084344 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0b36a3b6-9add-4f90-95f4-4f761400244f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:57.085169 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0b36a3b6-9add-4f90-95f4-4f761400244f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:57.085596 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0b36a3b6-9add-4f90-95f4-4f761400244f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:57.218317 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-4d73a05c-88c3-472f-b79c-88ac6392ea1e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:57.219006 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-4d73a05c-88c3-472f-b79c-88ac6392ea1e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:57.225734 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4d73a05c-88c3-472f-b79c-88ac6392ea1e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:57.226185 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4d73a05c-88c3-472f-b79c-88ac6392ea1e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:57.226937 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4d73a05c-88c3-472f-b79c-88ac6392ea1e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:57.227360 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4d73a05c-88c3-472f-b79c-88ac6392ea1e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:57.295730 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0b36a3b6-9add-4f90-95f4-4f761400244f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:57.303193 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0b36a3b6-9add-4f90-95f4-4f761400244f tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 200 len: 1318 microversion: 2.1 time: 0.231853 Sep 24 03:36:57.303770 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 448/886] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:57 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:57.308632 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ecf09e6f-a7ce-46d4-936c-ec94b9e8624d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:57.309524 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ecf09e6f-a7ce-46d4-936c-ec94b9e8624d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:57.315353 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ecf09e6f-a7ce-46d4-936c-ec94b9e8624d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:57.315858 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ecf09e6f-a7ce-46d4-936c-ec94b9e8624d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:57.316638 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ecf09e6f-a7ce-46d4-936c-ec94b9e8624d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:57.317314 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ecf09e6f-a7ce-46d4-936c-ec94b9e8624d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:57.390647 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ecf09e6f-a7ce-46d4-936c-ec94b9e8624d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 34555 microversion: 2.20 time: 0.085444 Sep 24 03:36:57.394739 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 449/887] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:57 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 34555 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:57.396625 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f6ed23fc-bc0d-4282-9714-17fd5d9e4a01 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:57.397604 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f6ed23fc-bc0d-4282-9714-17fd5d9e4a01 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:57.404596 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f6ed23fc-bc0d-4282-9714-17fd5d9e4a01 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:57.405040 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f6ed23fc-bc0d-4282-9714-17fd5d9e4a01 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:57.405842 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f6ed23fc-bc0d-4282-9714-17fd5d9e4a01 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:57.406270 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f6ed23fc-bc0d-4282-9714-17fd5d9e4a01 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:57.429558 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4d73a05c-88c3-472f-b79c-88ac6392ea1e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:57.438640 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-4d73a05c-88c3-472f-b79c-88ac6392ea1e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1260 microversion: 2.1 time: 0.224279 Sep 24 03:36:57.439218 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 439/888] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:57 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:57.495840 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f6ed23fc-bc0d-4282-9714-17fd5d9e4a01 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 27500 microversion: 2.1 time: 0.102730 Sep 24 03:36:57.496423 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 450/889] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:57 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 27500 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:36:58.320838 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3b21db4e-eb6f-4e5a-b30c-bf9ec6e5a611 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:58.321258 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3b21db4e-eb6f-4e5a-b30c-bf9ec6e5a611 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:58.333456 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3b21db4e-eb6f-4e5a-b30c-bf9ec6e5a611 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:58.333945 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3b21db4e-eb6f-4e5a-b30c-bf9ec6e5a611 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:58.334987 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3b21db4e-eb6f-4e5a-b30c-bf9ec6e5a611 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:58.335633 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3b21db4e-eb6f-4e5a-b30c-bf9ec6e5a611 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:58.402994 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-96294f47-98e2-42e2-98b1-4daa0588b0da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:58.404844 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-96294f47-98e2-42e2-98b1-4daa0588b0da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:58.411279 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-96294f47-98e2-42e2-98b1-4daa0588b0da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:58.411724 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-96294f47-98e2-42e2-98b1-4daa0588b0da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:58.412508 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-96294f47-98e2-42e2-98b1-4daa0588b0da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:58.412939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-96294f47-98e2-42e2-98b1-4daa0588b0da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:58.498531 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-96294f47-98e2-42e2-98b1-4daa0588b0da tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 35367 microversion: 2.20 time: 0.099504 Sep 24 03:36:58.503045 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 451/890] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:58 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 35367 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:36:58.505476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9259db87-ea10-4d7a-9a38-08455d8ca403 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:58.506205 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9259db87-ea10-4d7a-9a38-08455d8ca403 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:58.513134 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9259db87-ea10-4d7a-9a38-08455d8ca403 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:58.513579 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9259db87-ea10-4d7a-9a38-08455d8ca403 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:58.514379 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9259db87-ea10-4d7a-9a38-08455d8ca403 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:58.514813 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9259db87-ea10-4d7a-9a38-08455d8ca403 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:58.551662 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-3b21db4e-eb6f-4e5a-b30c-bf9ec6e5a611 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:58.561558 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3b21db4e-eb6f-4e5a-b30c-bf9ec6e5a611 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 200 len: 1318 microversion: 2.1 time: 0.244753 Sep 24 03:36:58.565811 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 440/891] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:58 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:58.571033 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ddfe2e6e-d43a-4881-8d09-5540aea6efd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:58.572145 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ddfe2e6e-d43a-4881-8d09-5540aea6efd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:58.578293 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ddfe2e6e-d43a-4881-8d09-5540aea6efd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:58.578814 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ddfe2e6e-d43a-4881-8d09-5540aea6efd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:58.579699 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ddfe2e6e-d43a-4881-8d09-5540aea6efd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:58.580328 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ddfe2e6e-d43a-4881-8d09-5540aea6efd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:58.660237 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ddfe2e6e-d43a-4881-8d09-5540aea6efd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 27769 microversion: 2.1 time: 0.092718 Sep 24 03:36:58.664204 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 441/892] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:58 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 27769 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:36:58.739279 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-9259db87-ea10-4d7a-9a38-08455d8ca403 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:58.747351 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9259db87-ea10-4d7a-9a38-08455d8ca403 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1260 microversion: 2.1 time: 0.245595 Sep 24 03:36:58.748014 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 452/893] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:58 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:36:59.511315 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6e362685-79d9-48a5-902c-b43228dccfb4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:59.512318 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6e362685-79d9-48a5-902c-b43228dccfb4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:59.518944 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6e362685-79d9-48a5-902c-b43228dccfb4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:59.519392 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6e362685-79d9-48a5-902c-b43228dccfb4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:59.520164 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6e362685-79d9-48a5-902c-b43228dccfb4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:59.520595 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6e362685-79d9-48a5-902c-b43228dccfb4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:59.578546 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-39538d53-c080-43e2-b1cc-f538d910a801 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:59.579179 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-39538d53-c080-43e2-b1cc-f538d910a801 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:59.585139 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-39538d53-c080-43e2-b1cc-f538d910a801 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:59.585573 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-39538d53-c080-43e2-b1cc-f538d910a801 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:59.586578 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-39538d53-c080-43e2-b1cc-f538d910a801 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:59.587003 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-39538d53-c080-43e2-b1cc-f538d910a801 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:59.601975 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6e362685-79d9-48a5-902c-b43228dccfb4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 36641 microversion: 2.20 time: 0.094676 Sep 24 03:36:59.604373 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 442/894] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:36:59 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 36641 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:36:59.672316 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-7c5e6950-e54c-4c70-b4b2-52ff70e269bc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:36:59.673305 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-7c5e6950-e54c-4c70-b4b2-52ff70e269bc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:59.679914 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7c5e6950-e54c-4c70-b4b2-52ff70e269bc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:59.680393 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7c5e6950-e54c-4c70-b4b2-52ff70e269bc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:59.681334 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7c5e6950-e54c-4c70-b4b2-52ff70e269bc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:59.683332 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7c5e6950-e54c-4c70-b4b2-52ff70e269bc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:59.767502 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-7c5e6950-e54c-4c70-b4b2-52ff70e269bc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 28174 microversion: 2.1 time: 0.098952 Sep 24 03:36:59.771611 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 443/895] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:36:59 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 28174 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:36:59.773113 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-328ffa78-c358-4096-8756-51cbbf603f22 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:36:59.773851 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-328ffa78-c358-4096-8756-51cbbf603f22 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:36:59.780886 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-328ffa78-c358-4096-8756-51cbbf603f22 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:59.781331 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-328ffa78-c358-4096-8756-51cbbf603f22 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:59.782270 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-328ffa78-c358-4096-8756-51cbbf603f22 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:36:59.782703 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-328ffa78-c358-4096-8756-51cbbf603f22 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:36:59.797160 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-39538d53-c080-43e2-b1cc-f538d910a801 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:59.805591 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-39538d53-c080-43e2-b1cc-f538d910a801 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 200 len: 1318 microversion: 2.1 time: 0.230722 Sep 24 03:36:59.806194 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 453/896] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:59 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:36:59.918752 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-328ffa78-c358-4096-8756-51cbbf603f22 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:36:59.934299 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-328ffa78-c358-4096-8756-51cbbf603f22 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1260 microversion: 2.1 time: 0.164933 Sep 24 03:36:59.934883 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 444/897] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:36:59 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:00.614778 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-dfdc5e96-db13-4cb4-a567-dfeb6d2217fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:00.615697 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-dfdc5e96-db13-4cb4-a567-dfeb6d2217fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:00.622118 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dfdc5e96-db13-4cb4-a567-dfeb6d2217fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:00.622569 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dfdc5e96-db13-4cb4-a567-dfeb6d2217fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:00.623339 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dfdc5e96-db13-4cb4-a567-dfeb6d2217fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:00.623770 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dfdc5e96-db13-4cb4-a567-dfeb6d2217fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:00.702629 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-dfdc5e96-db13-4cb4-a567-dfeb6d2217fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 37952 microversion: 2.20 time: 0.091759 Sep 24 03:37:00.704141 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 454/898] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:37:00 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 37952 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:37:00.779493 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-611427dc-e1bc-4080-9fab-7a02a8b1253b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:00.780821 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-611427dc-e1bc-4080-9fab-7a02a8b1253b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:00.789968 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-611427dc-e1bc-4080-9fab-7a02a8b1253b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:00.790419 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-611427dc-e1bc-4080-9fab-7a02a8b1253b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:00.791889 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-611427dc-e1bc-4080-9fab-7a02a8b1253b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:00.792322 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-611427dc-e1bc-4080-9fab-7a02a8b1253b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:00.822897 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-adb7072d-c450-4656-ba00-3ff1d24f1b39 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:00.823733 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-adb7072d-c450-4656-ba00-3ff1d24f1b39 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:00.830283 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-adb7072d-c450-4656-ba00-3ff1d24f1b39 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:00.831010 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-adb7072d-c450-4656-ba00-3ff1d24f1b39 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:00.832172 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-adb7072d-c450-4656-ba00-3ff1d24f1b39 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:00.832788 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-adb7072d-c450-4656-ba00-3ff1d24f1b39 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:00.873346 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-611427dc-e1bc-4080-9fab-7a02a8b1253b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 28174 microversion: 2.1 time: 0.097931 Sep 24 03:37:00.874496 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 445/899] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:00 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 28174 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:37:00.954854 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6904849c-eb9b-483b-ac75-338cdef09732 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:00.956629 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6904849c-eb9b-483b-ac75-338cdef09732 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:00.967218 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6904849c-eb9b-483b-ac75-338cdef09732 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:00.970347 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6904849c-eb9b-483b-ac75-338cdef09732 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:00.970347 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6904849c-eb9b-483b-ac75-338cdef09732 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:00.970347 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6904849c-eb9b-483b-ac75-338cdef09732 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:01.003130 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-adb7072d-c450-4656-ba00-3ff1d24f1b39 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:01.013538 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-adb7072d-c450-4656-ba00-3ff1d24f1b39 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 200 len: 1318 microversion: 2.1 time: 0.194566 Sep 24 03:37:01.024476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 455/900] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:00 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:01.161588 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6904849c-eb9b-483b-ac75-338cdef09732 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:01.171031 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6904849c-eb9b-483b-ac75-338cdef09732 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1260 microversion: 2.1 time: 0.221842 Sep 24 03:37:01.171612 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 446/901] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:00 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:01.255334 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-fca208b8-9d78-49f8-a4f6-501bcb3b8d15 req-51477022-099b-45bc-b93a-f2c82444a9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943878e5-6c60-468f-bb4b-83e2a59f5d4a", "name": "network-vif-plugged", "status": "completed", "tag": "0717861b-d1f6-493d-aa8d-5314188e7508"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:01.256914 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:37:01.256914 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:37:01.263906 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-fca208b8-9d78-49f8-a4f6-501bcb3b8d15 req-51477022-099b-45bc-b93a-f2c82444a9ca service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:01.264343 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-fca208b8-9d78-49f8-a4f6-501bcb3b8d15 req-51477022-099b-45bc-b93a-f2c82444a9ca service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:01.274873 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-fca208b8-9d78-49f8-a4f6-501bcb3b8d15 req-51477022-099b-45bc-b93a-f2c82444a9ca service nova] Creating event network-vif-plugged:0717861b-d1f6-493d-aa8d-5314188e7508 for instance 943878e5-6c60-468f-bb4b-83e2a59f5d4a on hv-cinder-81080 Sep 24 03:37:01.281198 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-fca208b8-9d78-49f8-a4f6-501bcb3b8d15 req-51477022-099b-45bc-b93a-f2c82444a9ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253977 Sep 24 03:37:01.281994 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 456/902] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:37:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:37:01.718775 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-78b131b4-8ed2-4bb8-a939-90e15628bf21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:01.719694 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-78b131b4-8ed2-4bb8-a939-90e15628bf21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:01.725527 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-78b131b4-8ed2-4bb8-a939-90e15628bf21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:01.726005 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-78b131b4-8ed2-4bb8-a939-90e15628bf21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:01.726803 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-78b131b4-8ed2-4bb8-a939-90e15628bf21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:01.727180 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-78b131b4-8ed2-4bb8-a939-90e15628bf21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:01.812777 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-78b131b4-8ed2-4bb8-a939-90e15628bf21 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 38191 microversion: 2.20 time: 0.100966 Sep 24 03:37:01.813463 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 447/903] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:37:01 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 38191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:37:01.887165 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a457a075-d3bf-4223-af37-f885a891abbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:01.888206 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a457a075-d3bf-4223-af37-f885a891abbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:01.894942 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a457a075-d3bf-4223-af37-f885a891abbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:01.895388 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a457a075-d3bf-4223-af37-f885a891abbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:01.896167 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a457a075-d3bf-4223-af37-f885a891abbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:01.896607 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a457a075-d3bf-4223-af37-f885a891abbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:02.003020 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a457a075-d3bf-4223-af37-f885a891abbc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 28465 microversion: 2.1 time: 0.120531 Sep 24 03:37:02.003666 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 457/904] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:01 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 28465 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:02.031032 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-230aa017-deae-40c9-a31d-b33da50eebd8 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:02.031736 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-230aa017-deae-40c9-a31d-b33da50eebd8 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:02.038180 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-230aa017-deae-40c9-a31d-b33da50eebd8 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:02.038616 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-230aa017-deae-40c9-a31d-b33da50eebd8 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:02.039370 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-230aa017-deae-40c9-a31d-b33da50eebd8 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:02.039793 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-230aa017-deae-40c9-a31d-b33da50eebd8 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:02.159245 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-230aa017-deae-40c9-a31d-b33da50eebd8 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:02.167481 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-230aa017-deae-40c9-a31d-b33da50eebd8 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 200 len: 1318 microversion: 2.1 time: 0.140110 Sep 24 03:37:02.168047 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 448/905] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:02 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:37:02.187811 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e362275f-8f08-4570-a062-f4aa23073aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:02.188504 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e362275f-8f08-4570-a062-f4aa23073aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:02.195002 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e362275f-8f08-4570-a062-f4aa23073aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:02.195440 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e362275f-8f08-4570-a062-f4aa23073aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:02.196206 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e362275f-8f08-4570-a062-f4aa23073aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:02.196634 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e362275f-8f08-4570-a062-f4aa23073aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:02.313950 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e362275f-8f08-4570-a062-f4aa23073aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:02.321182 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e362275f-8f08-4570-a062-f4aa23073aad tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1260 microversion: 2.1 time: 0.137440 Sep 24 03:37:02.321767 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 458/906] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:02 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1260 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:02.825144 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-fc7dca00-c6d7-4a32-8e14-8d1def255d23 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:02.825960 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-fc7dca00-c6d7-4a32-8e14-8d1def255d23 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:02.831781 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fc7dca00-c6d7-4a32-8e14-8d1def255d23 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:02.832237 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fc7dca00-c6d7-4a32-8e14-8d1def255d23 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:02.833011 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fc7dca00-c6d7-4a32-8e14-8d1def255d23 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:02.833447 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fc7dca00-c6d7-4a32-8e14-8d1def255d23 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:02.897194 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-fc7dca00-c6d7-4a32-8e14-8d1def255d23 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 38191 microversion: 2.20 time: 0.076349 Sep 24 03:37:02.897918 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 449/907] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:37:02 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 38191 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:37:03.014481 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3d6bc3da-3e29-41c7-893c-45ce29d86137 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:03.015392 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3d6bc3da-3e29-41c7-893c-45ce29d86137 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:03.021284 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3d6bc3da-3e29-41c7-893c-45ce29d86137 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:03.021760 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3d6bc3da-3e29-41c7-893c-45ce29d86137 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:03.022594 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3d6bc3da-3e29-41c7-893c-45ce29d86137 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:03.023023 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3d6bc3da-3e29-41c7-893c-45ce29d86137 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:03.085916 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3d6bc3da-3e29-41c7-893c-45ce29d86137 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 28465 microversion: 2.1 time: 0.074895 Sep 24 03:37:03.086732 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 459/908] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:03 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 28465 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:03.184507 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2f3e57f3-bcdf-4dd3-9db3-731ec4de7daa tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:03.185194 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2f3e57f3-bcdf-4dd3-9db3-731ec4de7daa tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:03.191628 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2f3e57f3-bcdf-4dd3-9db3-731ec4de7daa tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:03.192062 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2f3e57f3-bcdf-4dd3-9db3-731ec4de7daa tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:03.192813 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2f3e57f3-bcdf-4dd3-9db3-731ec4de7daa tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:03.193232 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2f3e57f3-bcdf-4dd3-9db3-731ec4de7daa tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:03.297308 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-a082c37a-1b6d-477b-b178-80c453354d4f req-2c562e0b-ae5c-48d5-858e-df804227f32c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a23918f-1f46-46ff-8559-df4e0d82e8d3", "name": "network-vif-plugged", "status": "completed", "tag": "0dfff50d-916c-4ef8-b736-5fe358a4016f"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:03.298824 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:37:03.298824 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:37:03.306132 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-a082c37a-1b6d-477b-b178-80c453354d4f req-2c562e0b-ae5c-48d5-858e-df804227f32c service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:03.307117 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-a082c37a-1b6d-477b-b178-80c453354d4f req-2c562e0b-ae5c-48d5-858e-df804227f32c service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:03.316491 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2f3e57f3-bcdf-4dd3-9db3-731ec4de7daa tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:03.317927 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-a082c37a-1b6d-477b-b178-80c453354d4f req-2c562e0b-ae5c-48d5-858e-df804227f32c service nova] Creating event network-vif-plugged:0dfff50d-916c-4ef8-b736-5fe358a4016f for instance 8a23918f-1f46-46ff-8559-df4e0d82e8d3 on hv-cinder-81080 Sep 24 03:37:03.323564 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-a082c37a-1b6d-477b-b178-80c453354d4f req-2c562e0b-ae5c-48d5-858e-df804227f32c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029304 Sep 24 03:37:03.324154 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 460/909] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:37:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:37:03.325145 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2f3e57f3-bcdf-4dd3-9db3-731ec4de7daa tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 200 len: 1507 microversion: 2.1 time: 0.144750 Sep 24 03:37:03.325705 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 450/910] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:03 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 1507 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:03.338823 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4bf550f9-462d-4676-9ebe-709bf5ac2684 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:03.339450 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4bf550f9-462d-4676-9ebe-709bf5ac2684 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:03.340993 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-caf4e1bf-4520-4886-aadc-e98cbb053410 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e332ed2-40f5-4d43-bc0f-1173f7ea10ed", "device": "/dev/sdb"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:03.342590 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-caf4e1bf-4520-4886-aadc-e98cbb053410 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:03.346399 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4bf550f9-462d-4676-9ebe-709bf5ac2684 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:03.346936 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4bf550f9-462d-4676-9ebe-709bf5ac2684 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:03.348085 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4bf550f9-462d-4676-9ebe-709bf5ac2684 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:03.348439 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-caf4e1bf-4520-4886-aadc-e98cbb053410 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:03.348545 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4bf550f9-462d-4676-9ebe-709bf5ac2684 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:03.348889 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-caf4e1bf-4520-4886-aadc-e98cbb053410 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:03.349685 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-caf4e1bf-4520-4886-aadc-e98cbb053410 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:03.350147 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-caf4e1bf-4520-4886-aadc-e98cbb053410 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:03.486278 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4bf550f9-462d-4676-9ebe-709bf5ac2684 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:03.494860 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4bf550f9-462d-4676-9ebe-709bf5ac2684 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1260 microversion: 2.1 time: 0.159247 Sep 24 03:37:03.495549 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 461/911] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:03 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:37:03.607749 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-caf4e1bf-4520-4886-aadc-e98cbb053410 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "POST /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270466 Sep 24 03:37:03.608341 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 451/912] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:37:03 2021] POST /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:37:03.911267 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3944725b-622e-4db3-9ecf-3a0eefa50b57 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:03.912176 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3944725b-622e-4db3-9ecf-3a0eefa50b57 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:03.918328 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3944725b-622e-4db3-9ecf-3a0eefa50b57 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:03.918770 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3944725b-622e-4db3-9ecf-3a0eefa50b57 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:03.919537 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3944725b-622e-4db3-9ecf-3a0eefa50b57 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:03.919958 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3944725b-622e-4db3-9ecf-3a0eefa50b57 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:03.992451 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3944725b-622e-4db3-9ecf-3a0eefa50b57 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 38191 microversion: 2.20 time: 0.086673 Sep 24 03:37:03.993079 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 462/913] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:37:03 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 38191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:37:04.097295 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-90478bba-13ad-4948-adcd-7b04c0a36f54 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:04.098377 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-90478bba-13ad-4948-adcd-7b04c0a36f54 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:04.105520 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-90478bba-13ad-4948-adcd-7b04c0a36f54 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:04.106000 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-90478bba-13ad-4948-adcd-7b04c0a36f54 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:04.106768 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-90478bba-13ad-4948-adcd-7b04c0a36f54 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:04.107202 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-90478bba-13ad-4948-adcd-7b04c0a36f54 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:04.191664 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-90478bba-13ad-4948-adcd-7b04c0a36f54 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 28633 microversion: 2.1 time: 0.098212 Sep 24 03:37:04.192201 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 452/914] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:04 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 28633 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:04.512551 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-db219dcf-0544-49b1-9932-bb37f0b1ff03 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:04.513252 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-db219dcf-0544-49b1-9932-bb37f0b1ff03 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:04.519620 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-db219dcf-0544-49b1-9932-bb37f0b1ff03 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:04.520062 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-db219dcf-0544-49b1-9932-bb37f0b1ff03 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:04.520809 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-db219dcf-0544-49b1-9932-bb37f0b1ff03 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:04.521229 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-db219dcf-0544-49b1-9932-bb37f0b1ff03 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:04.645669 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-db219dcf-0544-49b1-9932-bb37f0b1ff03 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:04.653064 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-db219dcf-0544-49b1-9932-bb37f0b1ff03 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1260 microversion: 2.1 time: 0.144485 Sep 24 03:37:04.653636 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 463/915] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:04 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1260 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:05.005497 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8dce7bc4-c94b-4b67-804f-27c609285afa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:05.006535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8dce7bc4-c94b-4b67-804f-27c609285afa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:05.013225 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8dce7bc4-c94b-4b67-804f-27c609285afa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:05.013670 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8dce7bc4-c94b-4b67-804f-27c609285afa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:05.014450 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8dce7bc4-c94b-4b67-804f-27c609285afa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:05.014875 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8dce7bc4-c94b-4b67-804f-27c609285afa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:05.086919 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8dce7bc4-c94b-4b67-804f-27c609285afa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 200 len: 38332 microversion: 2.20 time: 0.085274 Sep 24 03:37:05.087600 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 453/916] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:37:05 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 38332 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:37:05.097677 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-13e0e25b-9860-407e-8dea-55dfebfb69fe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:05.098185 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-13e0e25b-9860-407e-8dea-55dfebfb69fe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:05.104857 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-13e0e25b-9860-407e-8dea-55dfebfb69fe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:05.105290 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-13e0e25b-9860-407e-8dea-55dfebfb69fe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:05.106074 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-13e0e25b-9860-407e-8dea-55dfebfb69fe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:05.106495 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-13e0e25b-9860-407e-8dea-55dfebfb69fe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:05.129624 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-13e0e25b-9860-407e-8dea-55dfebfb69fe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/ips" status: 200 len: 151 microversion: 2.20 time: 0.035595 Sep 24 03:37:05.130196 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 464/917] 10.222.0.18 () {60 vars in 1289 bytes} [Fri Sep 24 03:37:05 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:05.204281 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8d2caddf-1f6d-4f7c-9ba9-ee1ea3186d2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:05.205275 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8d2caddf-1f6d-4f7c-9ba9-ee1ea3186d2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:05.211644 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8d2caddf-1f6d-4f7c-9ba9-ee1ea3186d2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:05.212086 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8d2caddf-1f6d-4f7c-9ba9-ee1ea3186d2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:05.213482 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8d2caddf-1f6d-4f7c-9ba9-ee1ea3186d2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:05.213947 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8d2caddf-1f6d-4f7c-9ba9-ee1ea3186d2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:05.276882 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8d2caddf-1f6d-4f7c-9ba9-ee1ea3186d2d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 28633 microversion: 2.1 time: 0.076277 Sep 24 03:37:05.280803 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 454/918] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:05 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 28633 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:05.670407 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6b30d9cb-c74f-4337-b962-cd09b13061ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:05.671008 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6b30d9cb-c74f-4337-b962-cd09b13061ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:05.677251 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6b30d9cb-c74f-4337-b962-cd09b13061ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:05.677889 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6b30d9cb-c74f-4337-b962-cd09b13061ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:05.678758 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6b30d9cb-c74f-4337-b962-cd09b13061ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:05.679336 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6b30d9cb-c74f-4337-b962-cd09b13061ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:05.799972 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6b30d9cb-c74f-4337-b962-cd09b13061ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:05.807352 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6b30d9cb-c74f-4337-b962-cd09b13061ef tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1444 microversion: 2.1 time: 0.141420 Sep 24 03:37:05.807902 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 465/919] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:05 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:05.823489 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-739d257a-57f4-4391-bf94-4b00f17a8057 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:05.824222 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-739d257a-57f4-4391-bf94-4b00f17a8057 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:05.830561 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-739d257a-57f4-4391-bf94-4b00f17a8057 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:05.831000 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-739d257a-57f4-4391-bf94-4b00f17a8057 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:05.831752 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-739d257a-57f4-4391-bf94-4b00f17a8057 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:05.832173 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-739d257a-57f4-4391-bf94-4b00f17a8057 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:05.951811 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-739d257a-57f4-4391-bf94-4b00f17a8057 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:05.959028 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-739d257a-57f4-4391-bf94-4b00f17a8057 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1444 microversion: 2.1 time: 0.139488 Sep 24 03:37:05.959596 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 455/920] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:05 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1444 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:06.288571 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8543f386-424a-471a-8c03-6281e8366ec1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:06.289696 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8543f386-424a-471a-8c03-6281e8366ec1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:06.295604 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8543f386-424a-471a-8c03-6281e8366ec1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:06.296033 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8543f386-424a-471a-8c03-6281e8366ec1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:06.296792 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8543f386-424a-471a-8c03-6281e8366ec1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:06.297214 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8543f386-424a-471a-8c03-6281e8366ec1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:06.363333 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8543f386-424a-471a-8c03-6281e8366ec1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 28633 microversion: 2.1 time: 0.078429 Sep 24 03:37:06.367478 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 466/921] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:06 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 28633 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:07.174867 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-7d79aac7-20da-456e-94ca-c43ee2a2db25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:07.175368 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-7d79aac7-20da-456e-94ca-c43ee2a2db25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:07.181979 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7d79aac7-20da-456e-94ca-c43ee2a2db25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:07.182225 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7d79aac7-20da-456e-94ca-c43ee2a2db25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:07.183006 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7d79aac7-20da-456e-94ca-c43ee2a2db25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:07.183426 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7d79aac7-20da-456e-94ca-c43ee2a2db25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:07.208063 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-7d79aac7-20da-456e-94ca-c43ee2a2db25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lazy-loading 'flavor' on Instance uuid 722368e5-ae83-4303-be1a-5e1d2d40fe87 {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:37:07.376203 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5e2efddf-d040-4045-8df4-d3f7a985f430 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:07.377190 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5e2efddf-d040-4045-8df4-d3f7a985f430 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:07.383557 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5e2efddf-d040-4045-8df4-d3f7a985f430 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:07.383998 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5e2efddf-d040-4045-8df4-d3f7a985f430 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:07.384784 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5e2efddf-d040-4045-8df4-d3f7a985f430 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:07.385534 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5e2efddf-d040-4045-8df4-d3f7a985f430 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:07.448351 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5e2efddf-d040-4045-8df4-d3f7a985f430 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 28633 microversion: 2.1 time: 0.075904 Sep 24 03:37:07.452456 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 467/922] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:07 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 28633 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:37:07.468886 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-7d79aac7-20da-456e-94ca-c43ee2a2db25 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 202 len: 0 microversion: 2.20 time: 0.297583 Sep 24 03:37:07.469807 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 456/923] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:37:07 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:37:07.479703 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-06ba4821-e4e5-4228-8f0c-940457ddec24 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:07.480073 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-06ba4821-e4e5-4228-8f0c-940457ddec24 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:07.490079 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-06ba4821-e4e5-4228-8f0c-940457ddec24 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:07.490388 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-06ba4821-e4e5-4228-8f0c-940457ddec24 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:07.491276 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-06ba4821-e4e5-4228-8f0c-940457ddec24 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:07.491591 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-06ba4821-e4e5-4228-8f0c-940457ddec24 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:07.619551 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-06ba4821-e4e5-4228-8f0c-940457ddec24 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:07.627428 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-06ba4821-e4e5-4228-8f0c-940457ddec24 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:07.628913 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-06ba4821-e4e5-4228-8f0c-940457ddec24 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:07.630087 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-06ba4821-e4e5-4228-8f0c-940457ddec24 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.155816 Sep 24 03:37:07.630640 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 468/924] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:07 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:07.868388 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-c2dfcf26-6651-45aa-8765-e88c8e24ef3b req-4fe80ec4-5737-43a0-8570-da4dbebc3041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a23918f-1f46-46ff-8559-df4e0d82e8d3", "tag": "0dfff50d-916c-4ef8-b736-5fe358a4016f"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:07.870009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:37:07.870009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:37:07.877517 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-c2dfcf26-6651-45aa-8765-e88c8e24ef3b req-4fe80ec4-5737-43a0-8570-da4dbebc3041 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:07.878074 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-c2dfcf26-6651-45aa-8765-e88c8e24ef3b req-4fe80ec4-5737-43a0-8570-da4dbebc3041 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:07.889692 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-c2dfcf26-6651-45aa-8765-e88c8e24ef3b req-4fe80ec4-5737-43a0-8570-da4dbebc3041 service nova] Creating event network-changed:0dfff50d-916c-4ef8-b736-5fe358a4016f for instance 8a23918f-1f46-46ff-8559-df4e0d82e8d3 on hv-cinder-81080 Sep 24 03:37:07.895079 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-c2dfcf26-6651-45aa-8765-e88c8e24ef3b req-4fe80ec4-5737-43a0-8570-da4dbebc3041 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160086 Sep 24 03:37:07.895938 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 457/925] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:37:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:37:08.460205 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-63eeb5b3-e67d-4767-95ee-132cc233aecf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:08.461313 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-63eeb5b3-e67d-4767-95ee-132cc233aecf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:08.467162 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-63eeb5b3-e67d-4767-95ee-132cc233aecf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:08.467603 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-63eeb5b3-e67d-4767-95ee-132cc233aecf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:08.468358 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-63eeb5b3-e67d-4767-95ee-132cc233aecf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:08.468778 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-63eeb5b3-e67d-4767-95ee-132cc233aecf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:08.551534 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-63eeb5b3-e67d-4767-95ee-132cc233aecf tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 29979 microversion: 2.1 time: 0.094756 Sep 24 03:37:08.555548 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 469/926] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:08 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 29979 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 03:37:08.648488 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8a947c79-fa48-4b3f-93f8-fc0e053c9838 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:08.649188 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8a947c79-fa48-4b3f-93f8-fc0e053c9838 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:08.655815 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8a947c79-fa48-4b3f-93f8-fc0e053c9838 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:08.656262 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8a947c79-fa48-4b3f-93f8-fc0e053c9838 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:08.657048 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8a947c79-fa48-4b3f-93f8-fc0e053c9838 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:08.657481 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8a947c79-fa48-4b3f-93f8-fc0e053c9838 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:08.784237 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8a947c79-fa48-4b3f-93f8-fc0e053c9838 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:08.792566 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8a947c79-fa48-4b3f-93f8-fc0e053c9838 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:08.794218 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8a947c79-fa48-4b3f-93f8-fc0e053c9838 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:08.795466 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8a947c79-fa48-4b3f-93f8-fc0e053c9838 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.151125 Sep 24 03:37:08.796111 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 458/927] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:08 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:09.563795 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b859595f-81c4-4ac6-9648-d26e1a5a5fa2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:09.564713 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b859595f-81c4-4ac6-9648-d26e1a5a5fa2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:09.571195 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b859595f-81c4-4ac6-9648-d26e1a5a5fa2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:09.571675 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b859595f-81c4-4ac6-9648-d26e1a5a5fa2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:09.572520 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b859595f-81c4-4ac6-9648-d26e1a5a5fa2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:09.572952 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b859595f-81c4-4ac6-9648-d26e1a5a5fa2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:09.664858 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b859595f-81c4-4ac6-9648-d26e1a5a5fa2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 31410 microversion: 2.1 time: 0.105016 Sep 24 03:37:09.665491 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 470/928] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:09 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 31410 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:09.812400 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8c17fed2-5c11-40e1-9262-4f5717078f2c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:09.813009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8c17fed2-5c11-40e1-9262-4f5717078f2c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:09.819349 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8c17fed2-5c11-40e1-9262-4f5717078f2c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:09.819730 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8c17fed2-5c11-40e1-9262-4f5717078f2c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:09.820490 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8c17fed2-5c11-40e1-9262-4f5717078f2c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:09.820920 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8c17fed2-5c11-40e1-9262-4f5717078f2c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:09.940187 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8c17fed2-5c11-40e1-9262-4f5717078f2c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:09.948507 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8c17fed2-5c11-40e1-9262-4f5717078f2c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:09.950068 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8c17fed2-5c11-40e1-9262-4f5717078f2c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:09.951219 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8c17fed2-5c11-40e1-9262-4f5717078f2c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.142546 Sep 24 03:37:09.951766 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 459/929] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:09 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:10.677094 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-29eede13-1120-40ef-b74a-29e4a9c3a1ca tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:10.678217 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-29eede13-1120-40ef-b74a-29e4a9c3a1ca tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:10.685535 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-29eede13-1120-40ef-b74a-29e4a9c3a1ca tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:10.686008 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-29eede13-1120-40ef-b74a-29e4a9c3a1ca tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:10.686774 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-29eede13-1120-40ef-b74a-29e4a9c3a1ca tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:10.687200 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-29eede13-1120-40ef-b74a-29e4a9c3a1ca tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:10.762681 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-29eede13-1120-40ef-b74a-29e4a9c3a1ca tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 32856 microversion: 2.1 time: 0.089491 Sep 24 03:37:10.763339 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 471/930] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:10 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 32856 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:10.971588 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ab6db6cf-7238-4833-a852-0aed2ba11a4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:10.974279 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ab6db6cf-7238-4833-a852-0aed2ba11a4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:10.981678 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ab6db6cf-7238-4833-a852-0aed2ba11a4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:10.982155 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ab6db6cf-7238-4833-a852-0aed2ba11a4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:10.982932 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ab6db6cf-7238-4833-a852-0aed2ba11a4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:10.983362 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ab6db6cf-7238-4833-a852-0aed2ba11a4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:11.135480 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ab6db6cf-7238-4833-a852-0aed2ba11a4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:11.143572 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ab6db6cf-7238-4833-a852-0aed2ba11a4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:11.145099 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ab6db6cf-7238-4833-a852-0aed2ba11a4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:11.146264 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ab6db6cf-7238-4833-a852-0aed2ba11a4c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.179271 Sep 24 03:37:11.146828 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 460/931] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:10 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:11.776119 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b6cbeb3c-fe02-47aa-a865-db13e123ebf9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:11.777114 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b6cbeb3c-fe02-47aa-a865-db13e123ebf9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:11.783639 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b6cbeb3c-fe02-47aa-a865-db13e123ebf9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:11.784076 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b6cbeb3c-fe02-47aa-a865-db13e123ebf9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:11.784876 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b6cbeb3c-fe02-47aa-a865-db13e123ebf9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:11.785303 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b6cbeb3c-fe02-47aa-a865-db13e123ebf9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:12.164446 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b75f5a03-b878-4b85-a690-b2c5f459bc8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:12.164966 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b75f5a03-b878-4b85-a690-b2c5f459bc8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:12.170812 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b75f5a03-b878-4b85-a690-b2c5f459bc8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:12.171247 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b75f5a03-b878-4b85-a690-b2c5f459bc8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:12.171995 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b75f5a03-b878-4b85-a690-b2c5f459bc8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:12.172423 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b75f5a03-b878-4b85-a690-b2c5f459bc8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:12.290817 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b75f5a03-b878-4b85-a690-b2c5f459bc8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:12.298855 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b75f5a03-b878-4b85-a690-b2c5f459bc8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:12.300361 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b75f5a03-b878-4b85-a690-b2c5f459bc8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:12.301528 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b75f5a03-b878-4b85-a690-b2c5f459bc8a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.141105 Sep 24 03:37:12.302111 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 461/932] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:12 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:13.319803 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3ae1a4c1-1e18-4c9c-a319-444ac78e93cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:13.320413 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3ae1a4c1-1e18-4c9c-a319-444ac78e93cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:13.326884 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ae1a4c1-1e18-4c9c-a319-444ac78e93cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:13.327330 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ae1a4c1-1e18-4c9c-a319-444ac78e93cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:13.328097 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ae1a4c1-1e18-4c9c-a319-444ac78e93cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:13.328524 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3ae1a4c1-1e18-4c9c-a319-444ac78e93cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:13.443778 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-3ae1a4c1-1e18-4c9c-a319-444ac78e93cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:13.452063 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-3ae1a4c1-1e18-4c9c-a319-444ac78e93cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:13.453556 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-3ae1a4c1-1e18-4c9c-a319-444ac78e93cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:13.454829 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3ae1a4c1-1e18-4c9c-a319-444ac78e93cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.138759 Sep 24 03:37:13.455394 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 462/933] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:13 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:14.472822 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-4492e1af-e032-4563-abbf-092b1fe17990 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:14.473439 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-4492e1af-e032-4563-abbf-092b1fe17990 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:14.480616 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4492e1af-e032-4563-abbf-092b1fe17990 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:14.481067 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4492e1af-e032-4563-abbf-092b1fe17990 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:14.481608 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b6cbeb3c-fe02-47aa-a865-db13e123ebf9 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 35595 microversion: 2.1 time: 2.709949 Sep 24 03:37:14.482044 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4492e1af-e032-4563-abbf-092b1fe17990 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:14.482268 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4492e1af-e032-4563-abbf-092b1fe17990 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:14.482689 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 472/934] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:11 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 35595 bytes in 2712 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:14.849184 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4492e1af-e032-4563-abbf-092b1fe17990 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:14.857495 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4492e1af-e032-4563-abbf-092b1fe17990 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:14.859041 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4492e1af-e032-4563-abbf-092b1fe17990 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:14.860183 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-4492e1af-e032-4563-abbf-092b1fe17990 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.391078 Sep 24 03:37:14.860997 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 463/935] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:14 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:15.493989 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d88d64fe-eb2e-411a-9fde-9269a08baf08 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:15.495936 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d88d64fe-eb2e-411a-9fde-9269a08baf08 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:15.502494 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d88d64fe-eb2e-411a-9fde-9269a08baf08 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:15.503108 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d88d64fe-eb2e-411a-9fde-9269a08baf08 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:15.504076 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d88d64fe-eb2e-411a-9fde-9269a08baf08 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:15.504809 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d88d64fe-eb2e-411a-9fde-9269a08baf08 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:15.585467 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d88d64fe-eb2e-411a-9fde-9269a08baf08 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 36495 microversion: 2.1 time: 0.095403 Sep 24 03:37:15.586292 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 473/936] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:15 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 36495 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:15.879645 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b25ec8c1-a043-4290-bf22-c9895d7e6bbe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:15.880240 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b25ec8c1-a043-4290-bf22-c9895d7e6bbe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:15.886578 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b25ec8c1-a043-4290-bf22-c9895d7e6bbe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:15.887016 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b25ec8c1-a043-4290-bf22-c9895d7e6bbe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:15.887764 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b25ec8c1-a043-4290-bf22-c9895d7e6bbe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:15.888186 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b25ec8c1-a043-4290-bf22-c9895d7e6bbe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:16.005032 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b25ec8c1-a043-4290-bf22-c9895d7e6bbe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:16.012545 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b25ec8c1-a043-4290-bf22-c9895d7e6bbe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:16.014237 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b25ec8c1-a043-4290-bf22-c9895d7e6bbe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:16.015373 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b25ec8c1-a043-4290-bf22-c9895d7e6bbe tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.139462 Sep 24 03:37:16.015928 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 464/937] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:15 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:16.597290 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-780d1734-82de-4011-bcc4-bfac23c047f6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:16.598311 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-780d1734-82de-4011-bcc4-bfac23c047f6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:16.604952 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-780d1734-82de-4011-bcc4-bfac23c047f6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:16.605394 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-780d1734-82de-4011-bcc4-bfac23c047f6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:16.606249 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-780d1734-82de-4011-bcc4-bfac23c047f6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:16.606683 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-780d1734-82de-4011-bcc4-bfac23c047f6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:17.033972 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ff81fd8a-6c42-491b-a5a3-7df6edb55f3f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:17.034576 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ff81fd8a-6c42-491b-a5a3-7df6edb55f3f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:17.040483 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ff81fd8a-6c42-491b-a5a3-7df6edb55f3f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:17.041447 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ff81fd8a-6c42-491b-a5a3-7df6edb55f3f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:17.042239 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ff81fd8a-6c42-491b-a5a3-7df6edb55f3f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:17.042674 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ff81fd8a-6c42-491b-a5a3-7df6edb55f3f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:17.161124 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ff81fd8a-6c42-491b-a5a3-7df6edb55f3f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:17.169312 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ff81fd8a-6c42-491b-a5a3-7df6edb55f3f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:17.170825 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ff81fd8a-6c42-491b-a5a3-7df6edb55f3f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:17.171956 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ff81fd8a-6c42-491b-a5a3-7df6edb55f3f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.141755 Sep 24 03:37:17.172518 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 465/938] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:17 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:18.190835 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a5efbe44-804f-4d2a-bc05-5dace15c6d26 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:18.191474 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a5efbe44-804f-4d2a-bc05-5dace15c6d26 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:18.197457 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a5efbe44-804f-4d2a-bc05-5dace15c6d26 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:18.197954 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a5efbe44-804f-4d2a-bc05-5dace15c6d26 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:18.198717 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a5efbe44-804f-4d2a-bc05-5dace15c6d26 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:18.199146 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a5efbe44-804f-4d2a-bc05-5dace15c6d26 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:18.321184 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a5efbe44-804f-4d2a-bc05-5dace15c6d26 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:18.329661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a5efbe44-804f-4d2a-bc05-5dace15c6d26 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:18.331172 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a5efbe44-804f-4d2a-bc05-5dace15c6d26 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:18.332317 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a5efbe44-804f-4d2a-bc05-5dace15c6d26 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.145334 Sep 24 03:37:18.332875 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 466/939] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:18 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:18.592338 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-780d1734-82de-4011-bcc4-bfac23c047f6 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 38166 microversion: 2.1 time: 1.998935 Sep 24 03:37:18.592985 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 474/940] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:16 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 38166 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:19.349769 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5d7c5db4-d7ec-4918-b02c-08fa4c0c0433 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:19.350429 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5d7c5db4-d7ec-4918-b02c-08fa4c0c0433 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:19.356778 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5d7c5db4-d7ec-4918-b02c-08fa4c0c0433 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:19.357222 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5d7c5db4-d7ec-4918-b02c-08fa4c0c0433 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:19.358004 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5d7c5db4-d7ec-4918-b02c-08fa4c0c0433 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:19.358433 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5d7c5db4-d7ec-4918-b02c-08fa4c0c0433 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:19.476552 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5d7c5db4-d7ec-4918-b02c-08fa4c0c0433 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:19.485190 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5d7c5db4-d7ec-4918-b02c-08fa4c0c0433 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:19.486976 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5d7c5db4-d7ec-4918-b02c-08fa4c0c0433 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:19.488124 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5d7c5db4-d7ec-4918-b02c-08fa4c0c0433 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.142092 Sep 24 03:37:19.488684 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 467/941] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:19 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:19.604863 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-dc34079a-4ebd-4922-a79f-fd11003a3f15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:19.606147 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-dc34079a-4ebd-4922-a79f-fd11003a3f15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:19.612803 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dc34079a-4ebd-4922-a79f-fd11003a3f15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:19.613250 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dc34079a-4ebd-4922-a79f-fd11003a3f15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:19.614041 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dc34079a-4ebd-4922-a79f-fd11003a3f15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:19.614466 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dc34079a-4ebd-4922-a79f-fd11003a3f15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:19.693014 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-dc34079a-4ebd-4922-a79f-fd11003a3f15 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 38171 microversion: 2.1 time: 0.092462 Sep 24 03:37:19.693662 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 475/942] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:19 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 38171 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:20.506913 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b671eac8-1850-4bc6-bff2-1dc39fbaf2e8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:20.507507 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b671eac8-1850-4bc6-bff2-1dc39fbaf2e8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:20.514105 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b671eac8-1850-4bc6-bff2-1dc39fbaf2e8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:20.514542 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b671eac8-1850-4bc6-bff2-1dc39fbaf2e8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:20.515292 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b671eac8-1850-4bc6-bff2-1dc39fbaf2e8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:20.515715 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b671eac8-1850-4bc6-bff2-1dc39fbaf2e8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:20.632856 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b671eac8-1850-4bc6-bff2-1dc39fbaf2e8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:20.641152 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b671eac8-1850-4bc6-bff2-1dc39fbaf2e8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:20.642657 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b671eac8-1850-4bc6-bff2-1dc39fbaf2e8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:20.643798 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b671eac8-1850-4bc6-bff2-1dc39fbaf2e8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.140558 Sep 24 03:37:20.644354 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 468/943] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:20 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:20.705090 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2800d2d9-2996-4131-bf4c-01e3186448a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:20.706103 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2800d2d9-2996-4131-bf4c-01e3186448a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:20.712449 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2800d2d9-2996-4131-bf4c-01e3186448a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:20.712892 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2800d2d9-2996-4131-bf4c-01e3186448a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:20.713746 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2800d2d9-2996-4131-bf4c-01e3186448a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:20.714176 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2800d2d9-2996-4131-bf4c-01e3186448a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:20.803005 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2800d2d9-2996-4131-bf4c-01e3186448a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action" status: 200 len: 38297 microversion: 2.1 time: 0.101711 Sep 24 03:37:20.803658 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 476/944] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:37:20 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/action => generated 38297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:20.813768 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2bac3e3c-2ecd-4d91-bc50-91fb1142745a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:20.814251 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2bac3e3c-2ecd-4d91-bc50-91fb1142745a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:20.819999 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2bac3e3c-2ecd-4d91-bc50-91fb1142745a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:20.820438 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2bac3e3c-2ecd-4d91-bc50-91fb1142745a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:20.821186 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2bac3e3c-2ecd-4d91-bc50-91fb1142745a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:20.821607 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2bac3e3c-2ecd-4d91-bc50-91fb1142745a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:20.846858 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2bac3e3c-2ecd-4d91-bc50-91fb1142745a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/ips" status: 200 len: 145 microversion: 2.1 time: 0.036763 Sep 24 03:37:20.847410 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 469/945] 10.222.0.18 () {58 vars in 1248 bytes} [Fri Sep 24 03:37:20 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:37:21.661862 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ee5c8e88-74dd-4d6d-bebe-a4112004fa7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:21.662547 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ee5c8e88-74dd-4d6d-bebe-a4112004fa7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:21.669542 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ee5c8e88-74dd-4d6d-bebe-a4112004fa7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:21.670022 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ee5c8e88-74dd-4d6d-bebe-a4112004fa7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:21.670782 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ee5c8e88-74dd-4d6d-bebe-a4112004fa7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:21.671203 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ee5c8e88-74dd-4d6d-bebe-a4112004fa7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:21.800316 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ee5c8e88-74dd-4d6d-bebe-a4112004fa7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:21.809048 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ee5c8e88-74dd-4d6d-bebe-a4112004fa7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:21.810577 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ee5c8e88-74dd-4d6d-bebe-a4112004fa7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:21.811896 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ee5c8e88-74dd-4d6d-bebe-a4112004fa7c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.154122 Sep 24 03:37:21.812455 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 477/946] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:21 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:22.170343 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-673c8d13-3129-4fd7-8e1e-7829933815a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bce9deed-a749-491e-b7a4-1e90b86132ae"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:22.171376 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-673c8d13-3129-4fd7-8e1e-7829933815a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:22.177028 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-673c8d13-3129-4fd7-8e1e-7829933815a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:22.177464 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-673c8d13-3129-4fd7-8e1e-7829933815a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:22.178251 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-673c8d13-3129-4fd7-8e1e-7829933815a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:22.178671 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-673c8d13-3129-4fd7-8e1e-7829933815a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:22.411669 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-673c8d13-3129-4fd7-8e1e-7829933815a8 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244955 Sep 24 03:37:22.412273 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 470/947] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:37:22 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:37:22.829845 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d2e9a4ac-7381-4628-825e-9c1cae1aed47 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:22.830403 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d2e9a4ac-7381-4628-825e-9c1cae1aed47 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:22.836800 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d2e9a4ac-7381-4628-825e-9c1cae1aed47 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:22.837336 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d2e9a4ac-7381-4628-825e-9c1cae1aed47 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:22.838207 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d2e9a4ac-7381-4628-825e-9c1cae1aed47 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:22.838685 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d2e9a4ac-7381-4628-825e-9c1cae1aed47 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:22.896060 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ad3cef58-865f-4e64-a4c5-e0237a113944 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:22.896628 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ad3cef58-865f-4e64-a4c5-e0237a113944 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:22.903445 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad3cef58-865f-4e64-a4c5-e0237a113944 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:22.903877 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad3cef58-865f-4e64-a4c5-e0237a113944 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:22.904642 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad3cef58-865f-4e64-a4c5-e0237a113944 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:22.905115 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ad3cef58-865f-4e64-a4c5-e0237a113944 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:22.963124 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d2e9a4ac-7381-4628-825e-9c1cae1aed47 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:22.972863 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d2e9a4ac-7381-4628-825e-9c1cae1aed47 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:22.975914 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d2e9a4ac-7381-4628-825e-9c1cae1aed47 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:22.975914 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d2e9a4ac-7381-4628-825e-9c1cae1aed47 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.149649 Sep 24 03:37:22.982202 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 478/948] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:22 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:22.995733 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-ad3cef58-865f-4e64-a4c5-e0237a113944 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lazy-loading 'services' on Instance uuid 943878e5-6c60-468f-bb4b-83e2a59f5d4a {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:37:23.058243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ad3cef58-865f-4e64-a4c5-e0237a113944 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "DELETE /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a/os-volume_attachments/5e332ed2-40f5-4d43-bc0f-1173f7ea10ed" status: 202 len: 0 microversion: 2.1 time: 0.165973 Sep 24 03:37:23.059054 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 471/949] 10.222.0.18 () {58 vars in 1416 bytes} [Fri Sep 24 03:37:22 2021] DELETE /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a/os-volume_attachments/5e332ed2-40f5-4d43-bc0f-1173f7ea10ed => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:37:23.994048 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3619be25-c5a9-467f-82ee-7a75eb8eb144 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:23.994650 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3619be25-c5a9-467f-82ee-7a75eb8eb144 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:24.001637 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3619be25-c5a9-467f-82ee-7a75eb8eb144 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:24.002112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3619be25-c5a9-467f-82ee-7a75eb8eb144 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:24.002872 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3619be25-c5a9-467f-82ee-7a75eb8eb144 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:24.003299 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3619be25-c5a9-467f-82ee-7a75eb8eb144 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:24.121973 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3619be25-c5a9-467f-82ee-7a75eb8eb144 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:24.129688 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3619be25-c5a9-467f-82ee-7a75eb8eb144 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:24.131193 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3619be25-c5a9-467f-82ee-7a75eb8eb144 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:24.132338 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3619be25-c5a9-467f-82ee-7a75eb8eb144 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1744 microversion: 2.20 time: 0.141987 Sep 24 03:37:24.132897 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 479/950] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:23 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1744 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:25.151735 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6e892afa-9425-4774-b7dc-b7a3d50a82a6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:25.152431 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6e892afa-9425-4774-b7dc-b7a3d50a82a6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:25.158844 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6e892afa-9425-4774-b7dc-b7a3d50a82a6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:25.159292 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6e892afa-9425-4774-b7dc-b7a3d50a82a6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:25.160067 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6e892afa-9425-4774-b7dc-b7a3d50a82a6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:25.160506 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6e892afa-9425-4774-b7dc-b7a3d50a82a6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:25.313014 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6e892afa-9425-4774-b7dc-b7a3d50a82a6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:25.320570 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6e892afa-9425-4774-b7dc-b7a3d50a82a6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:25.322072 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6e892afa-9425-4774-b7dc-b7a3d50a82a6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:25.323214 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6e892afa-9425-4774-b7dc-b7a3d50a82a6 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1744 microversion: 2.20 time: 0.175661 Sep 24 03:37:25.324486 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 472/951] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:25 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:26.342755 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9738ebd0-1b38-46c1-819e-c89c61e15df3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:26.343390 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9738ebd0-1b38-46c1-819e-c89c61e15df3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:26.349596 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9738ebd0-1b38-46c1-819e-c89c61e15df3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:26.350082 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9738ebd0-1b38-46c1-819e-c89c61e15df3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:26.350857 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9738ebd0-1b38-46c1-819e-c89c61e15df3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:26.351284 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9738ebd0-1b38-46c1-819e-c89c61e15df3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:26.476475 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-9738ebd0-1b38-46c1-819e-c89c61e15df3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:26.484757 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-9738ebd0-1b38-46c1-819e-c89c61e15df3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:26.486564 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-9738ebd0-1b38-46c1-819e-c89c61e15df3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:26.487736 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9738ebd0-1b38-46c1-819e-c89c61e15df3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1739 microversion: 2.20 time: 0.149803 Sep 24 03:37:26.488244 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 480/952] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:26 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:27.506164 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2bd5d625-036c-460b-8be7-4c55562f7286 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:27.507164 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2bd5d625-036c-460b-8be7-4c55562f7286 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:27.514296 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2bd5d625-036c-460b-8be7-4c55562f7286 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:27.514961 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2bd5d625-036c-460b-8be7-4c55562f7286 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:27.516018 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2bd5d625-036c-460b-8be7-4c55562f7286 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:27.516328 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2bd5d625-036c-460b-8be7-4c55562f7286 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:27.647480 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2bd5d625-036c-460b-8be7-4c55562f7286 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:27.656044 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2bd5d625-036c-460b-8be7-4c55562f7286 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:27.657546 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2bd5d625-036c-460b-8be7-4c55562f7286 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:27.661829 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2bd5d625-036c-460b-8be7-4c55562f7286 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1739 microversion: 2.20 time: 0.159195 Sep 24 03:37:27.672611 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 473/953] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:27 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:28.681677 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-623ad66a-f1d5-474f-88a0-83e6a39f4dc3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:28.683748 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-623ad66a-f1d5-474f-88a0-83e6a39f4dc3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:28.690722 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-623ad66a-f1d5-474f-88a0-83e6a39f4dc3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:28.691192 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-623ad66a-f1d5-474f-88a0-83e6a39f4dc3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:28.692215 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-623ad66a-f1d5-474f-88a0-83e6a39f4dc3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:28.692655 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-623ad66a-f1d5-474f-88a0-83e6a39f4dc3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:28.833999 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-623ad66a-f1d5-474f-88a0-83e6a39f4dc3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:28.843680 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-623ad66a-f1d5-474f-88a0-83e6a39f4dc3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:28.846821 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-623ad66a-f1d5-474f-88a0-83e6a39f4dc3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:28.848072 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-623ad66a-f1d5-474f-88a0-83e6a39f4dc3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1739 microversion: 2.20 time: 0.171441 Sep 24 03:37:28.854106 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 481/954] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:28 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:29.040869 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-4ed39c96-ce71-484a-b7a6-7d4a559f4d19 req-947d4282-b687-4c3b-b05f-5b797474c15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722368e5-ae83-4303-be1a-5e1d2d40fe87", "name": "network-vif-plugged", "status": "completed", "tag": "8c1f1a3d-b239-4f20-8ebe-d00fa864b558"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:29.044316 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:37:29.044316 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:37:29.057559 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-4ed39c96-ce71-484a-b7a6-7d4a559f4d19 req-947d4282-b687-4c3b-b05f-5b797474c15e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:29.058181 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-4ed39c96-ce71-484a-b7a6-7d4a559f4d19 req-947d4282-b687-4c3b-b05f-5b797474c15e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:29.072076 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-4ed39c96-ce71-484a-b7a6-7d4a559f4d19 req-947d4282-b687-4c3b-b05f-5b797474c15e service nova] Creating event network-vif-plugged:8c1f1a3d-b239-4f20-8ebe-d00fa864b558 for instance 722368e5-ae83-4303-be1a-5e1d2d40fe87 on hv-cinder-81080 Sep 24 03:37:29.079293 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-4ed39c96-ce71-484a-b7a6-7d4a559f4d19 req-947d4282-b687-4c3b-b05f-5b797474c15e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042246 Sep 24 03:37:29.080156 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 474/955] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:37:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:37:29.868802 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ca91a08e-b9f8-4d81-866a-9ba439327b1f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:29.871058 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ca91a08e-b9f8-4d81-866a-9ba439327b1f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:29.882723 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ca91a08e-b9f8-4d81-866a-9ba439327b1f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:29.883462 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ca91a08e-b9f8-4d81-866a-9ba439327b1f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:29.884639 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ca91a08e-b9f8-4d81-866a-9ba439327b1f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:29.885271 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ca91a08e-b9f8-4d81-866a-9ba439327b1f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:30.036420 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-abbe93d4-9ba1-4ad0-be81-d06c10406315 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:30.037644 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-abbe93d4-9ba1-4ad0-be81-d06c10406315 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:30.044416 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-abbe93d4-9ba1-4ad0-be81-d06c10406315 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:30.045558 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-abbe93d4-9ba1-4ad0-be81-d06c10406315 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:30.046363 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-abbe93d4-9ba1-4ad0-be81-d06c10406315 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:30.046956 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-abbe93d4-9ba1-4ad0-be81-d06c10406315 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:30.074031 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ca91a08e-b9f8-4d81-866a-9ba439327b1f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:30.082610 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ca91a08e-b9f8-4d81-866a-9ba439327b1f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:30.084105 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ca91a08e-b9f8-4d81-866a-9ba439327b1f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:30.085264 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ca91a08e-b9f8-4d81-866a-9ba439327b1f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1739 microversion: 2.20 time: 0.222294 Sep 24 03:37:30.091808 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-abbe93d4-9ba1-4ad0-be81-d06c10406315 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059586 Sep 24 03:37:30.093045 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 475/956] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:37:30 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:37:30.101309 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 482/957] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:29 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:30.106662 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-92222c2a-7635-4321-91c1-3d0d82774fd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:30.107204 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-92222c2a-7635-4321-91c1-3d0d82774fd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:30.114395 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92222c2a-7635-4321-91c1-3d0d82774fd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:30.114897 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92222c2a-7635-4321-91c1-3d0d82774fd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:30.115720 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92222c2a-7635-4321-91c1-3d0d82774fd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:30.116157 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92222c2a-7635-4321-91c1-3d0d82774fd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:30.151672 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-92222c2a-7635-4321-91c1-3d0d82774fd1 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments/bce9deed-a749-491e-b7a4-1e90b86132ae" status: 200 len: 194 microversion: 2.1 time: 0.049361 Sep 24 03:37:30.153762 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 476/958] 10.222.0.18 () {58 vars in 1413 bytes} [Fri Sep 24 03:37:30 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments/bce9deed-a749-491e-b7a4-1e90b86132ae => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:37:30.572500 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-45ab6e21-fb06-47da-91b4-1cfcd63dd39d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:30.574020 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-45ab6e21-fb06-47da-91b4-1cfcd63dd39d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:30.580931 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-45ab6e21-fb06-47da-91b4-1cfcd63dd39d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:30.581647 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-45ab6e21-fb06-47da-91b4-1cfcd63dd39d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:30.582613 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-45ab6e21-fb06-47da-91b4-1cfcd63dd39d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:30.583032 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-45ab6e21-fb06-47da-91b4-1cfcd63dd39d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:30.611498 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-45ab6e21-fb06-47da-91b4-1cfcd63dd39d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Going to try to terminate instance {{(pid=109374) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:37:30.713364 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-45ab6e21-fb06-47da-91b4-1cfcd63dd39d tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "DELETE /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 204 len: 0 microversion: 2.1 time: 0.144033 Sep 24 03:37:30.714800 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 483/959] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:37:30 2021] DELETE /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:37:30.722782 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c78cdb74-6d30-4cce-9040-4bd461d32602 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:30.724488 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c78cdb74-6d30-4cce-9040-4bd461d32602 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:30.732091 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c78cdb74-6d30-4cce-9040-4bd461d32602 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:30.732627 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c78cdb74-6d30-4cce-9040-4bd461d32602 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:30.733390 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c78cdb74-6d30-4cce-9040-4bd461d32602 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:30.733845 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c78cdb74-6d30-4cce-9040-4bd461d32602 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:30.880620 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c78cdb74-6d30-4cce-9040-4bd461d32602 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:30.891109 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c78cdb74-6d30-4cce-9040-4bd461d32602 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 200 len: 1513 microversion: 2.1 time: 0.171984 Sep 24 03:37:30.892395 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 477/960] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:30 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:37:31.104766 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5f4ed2ef-0de0-487f-a545-d20d2c880ba3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:31.105779 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5f4ed2ef-0de0-487f-a545-d20d2c880ba3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:31.112538 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f4ed2ef-0de0-487f-a545-d20d2c880ba3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:31.113207 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f4ed2ef-0de0-487f-a545-d20d2c880ba3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:31.114208 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f4ed2ef-0de0-487f-a545-d20d2c880ba3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:31.114640 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f4ed2ef-0de0-487f-a545-d20d2c880ba3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:31.257599 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5f4ed2ef-0de0-487f-a545-d20d2c880ba3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:31.265857 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5f4ed2ef-0de0-487f-a545-d20d2c880ba3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:31.267637 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5f4ed2ef-0de0-487f-a545-d20d2c880ba3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:31.269138 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5f4ed2ef-0de0-487f-a545-d20d2c880ba3 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1739 microversion: 2.20 time: 0.168293 Sep 24 03:37:31.269749 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 484/961] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:31 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:31.538081 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-92712c17-ca8e-4562-86eb-7dde1472d6c4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44c89e73-8daf-45e3-9c1a-44d236c875a1"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:31.539710 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-92712c17-ca8e-4562-86eb-7dde1472d6c4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:31.551250 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92712c17-ca8e-4562-86eb-7dde1472d6c4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:31.551966 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92712c17-ca8e-4562-86eb-7dde1472d6c4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:31.552922 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92712c17-ca8e-4562-86eb-7dde1472d6c4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:31.553352 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-92712c17-ca8e-4562-86eb-7dde1472d6c4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:31.838458 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-92712c17-ca8e-4562-86eb-7dde1472d6c4 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303758 Sep 24 03:37:31.839189 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 478/962] 10.222.0.18 () {60 vars in 1323 bytes} [Fri Sep 24 03:37:31 2021] POST /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:37:31.920485 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9d4426c5-a249-4485-9838-bc0609ea9d29 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:31.921122 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9d4426c5-a249-4485-9838-bc0609ea9d29 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:31.928622 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9d4426c5-a249-4485-9838-bc0609ea9d29 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:31.929184 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9d4426c5-a249-4485-9838-bc0609ea9d29 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:31.933039 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9d4426c5-a249-4485-9838-bc0609ea9d29 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:31.934184 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9d4426c5-a249-4485-9838-bc0609ea9d29 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:32.077280 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-9d4426c5-a249-4485-9838-bc0609ea9d29 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:32.085347 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9d4426c5-a249-4485-9838-bc0609ea9d29 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 200 len: 1513 microversion: 2.1 time: 0.170857 Sep 24 03:37:32.085972 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 485/963] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:31 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:32.288558 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e4371b79-39e1-4653-a446-caabdffa626e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:32.289173 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e4371b79-39e1-4653-a446-caabdffa626e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:32.296113 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e4371b79-39e1-4653-a446-caabdffa626e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:32.296554 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e4371b79-39e1-4653-a446-caabdffa626e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:32.297342 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e4371b79-39e1-4653-a446-caabdffa626e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:32.298016 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e4371b79-39e1-4653-a446-caabdffa626e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:32.443976 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e4371b79-39e1-4653-a446-caabdffa626e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:32.453517 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e4371b79-39e1-4653-a446-caabdffa626e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:32.455081 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e4371b79-39e1-4653-a446-caabdffa626e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:32.456301 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e4371b79-39e1-4653-a446-caabdffa626e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1739 microversion: 2.20 time: 0.172054 Sep 24 03:37:32.456868 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 479/964] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:32 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:33.105368 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d844c0de-0d8c-4061-b7ff-c25efbc21f1a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:33.106624 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d844c0de-0d8c-4061-b7ff-c25efbc21f1a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:33.112150 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d844c0de-0d8c-4061-b7ff-c25efbc21f1a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:33.112795 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d844c0de-0d8c-4061-b7ff-c25efbc21f1a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:33.113769 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d844c0de-0d8c-4061-b7ff-c25efbc21f1a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:33.114357 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d844c0de-0d8c-4061-b7ff-c25efbc21f1a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:33.334055 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-f2b4d779-72c3-4353-9e42-40b02f9524d8 req-ffa99822-ca09-4964-b0d8-8c3924a9254e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943878e5-6c60-468f-bb4b-83e2a59f5d4a", "name": "network-vif-deleted", "tag": "0717861b-d1f6-493d-aa8d-5314188e7508"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:33.336540 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:37:33.336540 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:37:33.347475 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-f2b4d779-72c3-4353-9e42-40b02f9524d8 req-ffa99822-ca09-4964-b0d8-8c3924a9254e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:33.348171 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-f2b4d779-72c3-4353-9e42-40b02f9524d8 req-ffa99822-ca09-4964-b0d8-8c3924a9254e service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:33.363249 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-d844c0de-0d8c-4061-b7ff-c25efbc21f1a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40ce35e824ae44ce8f1a9d3268fda85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90f5ee150c84714b914726dff583040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:33.366963 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-f2b4d779-72c3-4353-9e42-40b02f9524d8 req-ffa99822-ca09-4964-b0d8-8c3924a9254e service nova] Creating event network-vif-deleted:0717861b-d1f6-493d-aa8d-5314188e7508 for instance 943878e5-6c60-468f-bb4b-83e2a59f5d4a on hv-cinder-81080 Sep 24 03:37:33.373275 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d844c0de-0d8c-4061-b7ff-c25efbc21f1a tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 200 len: 1513 microversion: 2.1 time: 0.273221 Sep 24 03:37:33.374491 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-f2b4d779-72c3-4353-9e42-40b02f9524d8 req-ffa99822-ca09-4964-b0d8-8c3924a9254e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046075 Sep 24 03:37:33.375050 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 486/965] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:33 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 1513 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:33.375768 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 480/966] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:37:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:37:33.474892 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0f1aadeb-9e86-4c59-95d0-6ec61e3c6e72 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:33.475819 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0f1aadeb-9e86-4c59-95d0-6ec61e3c6e72 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:33.483696 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0f1aadeb-9e86-4c59-95d0-6ec61e3c6e72 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:33.484552 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0f1aadeb-9e86-4c59-95d0-6ec61e3c6e72 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:33.485612 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0f1aadeb-9e86-4c59-95d0-6ec61e3c6e72 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:33.486187 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0f1aadeb-9e86-4c59-95d0-6ec61e3c6e72 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:33.626574 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0f1aadeb-9e86-4c59-95d0-6ec61e3c6e72 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:33.638890 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0f1aadeb-9e86-4c59-95d0-6ec61e3c6e72 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:33.640507 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0f1aadeb-9e86-4c59-95d0-6ec61e3c6e72 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:33.641807 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0f1aadeb-9e86-4c59-95d0-6ec61e3c6e72 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1739 microversion: 2.20 time: 0.170568 Sep 24 03:37:33.646083 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 487/967] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:33 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:34.392155 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1cacd294-29f5-4eae-a863-0fff65000134 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:34.392848 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1cacd294-29f5-4eae-a863-0fff65000134 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] [instance: 943878e5-6c60-468f-bb4b-83e2a59f5d4a] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:34.403098 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1cacd294-29f5-4eae-a863-0fff65000134 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:34.403789 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1cacd294-29f5-4eae-a863-0fff65000134 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:34.404768 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1cacd294-29f5-4eae-a863-0fff65000134 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:34.405372 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1cacd294-29f5-4eae-a863-0fff65000134 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:34.418951 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-1cacd294-29f5-4eae-a863-0fff65000134 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] HTTP exception thrown: Instance 943878e5-6c60-468f-bb4b-83e2a59f5d4a could not be found. Sep 24 03:37:34.419922 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1cacd294-29f5-4eae-a863-0fff65000134 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] Returning 404 to user: Instance 943878e5-6c60-468f-bb4b-83e2a59f5d4a could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:37:34.420762 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1cacd294-29f5-4eae-a863-0fff65000134 tempest-VolumesSnapshotTestJSON-241275680 tempest-VolumesSnapshotTestJSON-241275680-project] 10.222.0.18 "GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a" status: 404 len: 111 microversion: 2.1 time: 0.032666 Sep 24 03:37:34.421507 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 481/968] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:34 2021] GET /compute/v2.1/servers/943878e5-6c60-468f-bb4b-83e2a59f5d4a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:37:34.661636 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1f2d7da9-fb92-4154-82e3-cabb430cc299 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:34.662300 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1f2d7da9-fb92-4154-82e3-cabb430cc299 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:34.672172 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1f2d7da9-fb92-4154-82e3-cabb430cc299 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:34.672613 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1f2d7da9-fb92-4154-82e3-cabb430cc299 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:34.673388 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1f2d7da9-fb92-4154-82e3-cabb430cc299 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:34.673843 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1f2d7da9-fb92-4154-82e3-cabb430cc299 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:34.838036 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1f2d7da9-fb92-4154-82e3-cabb430cc299 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:34.847673 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1f2d7da9-fb92-4154-82e3-cabb430cc299 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:34.849422 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1f2d7da9-fb92-4154-82e3-cabb430cc299 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:34.850686 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1f2d7da9-fb92-4154-82e3-cabb430cc299 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1739 microversion: 2.20 time: 0.193088 Sep 24 03:37:34.862743 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 488/969] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:34 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:35.869129 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-bbb21ca6-d300-462e-b17e-1d00384f9cfa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:35.869761 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-bbb21ca6-d300-462e-b17e-1d00384f9cfa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:35.876631 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bbb21ca6-d300-462e-b17e-1d00384f9cfa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:35.877075 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bbb21ca6-d300-462e-b17e-1d00384f9cfa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:35.877867 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bbb21ca6-d300-462e-b17e-1d00384f9cfa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:35.878296 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-bbb21ca6-d300-462e-b17e-1d00384f9cfa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:36.012932 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-bbb21ca6-d300-462e-b17e-1d00384f9cfa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:36.020733 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-bbb21ca6-d300-462e-b17e-1d00384f9cfa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:36.022472 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-bbb21ca6-d300-462e-b17e-1d00384f9cfa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:36.023622 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-bbb21ca6-d300-462e-b17e-1d00384f9cfa tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1739 microversion: 2.20 time: 0.158172 Sep 24 03:37:36.024175 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 482/970] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:35 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:37.041339 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-02ce7a96-3341-48b6-a07a-f7d80406a550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:37.043122 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-02ce7a96-3341-48b6-a07a-f7d80406a550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:37.048865 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02ce7a96-3341-48b6-a07a-f7d80406a550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:37.049307 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02ce7a96-3341-48b6-a07a-f7d80406a550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:37.050095 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02ce7a96-3341-48b6-a07a-f7d80406a550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:37.050524 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02ce7a96-3341-48b6-a07a-f7d80406a550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:37.173516 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-02ce7a96-3341-48b6-a07a-f7d80406a550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:37.181438 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-02ce7a96-3341-48b6-a07a-f7d80406a550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:37.183903 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-02ce7a96-3341-48b6-a07a-f7d80406a550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:37.185048 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-02ce7a96-3341-48b6-a07a-f7d80406a550 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1721 microversion: 2.20 time: 0.147438 Sep 24 03:37:37.185614 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 489/971] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:37 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:38.203306 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1ce6dfe4-6d74-43e1-abcb-f76866d74b5b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:38.203839 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1ce6dfe4-6d74-43e1-abcb-f76866d74b5b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:38.209521 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1ce6dfe4-6d74-43e1-abcb-f76866d74b5b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:38.210002 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1ce6dfe4-6d74-43e1-abcb-f76866d74b5b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:38.210761 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1ce6dfe4-6d74-43e1-abcb-f76866d74b5b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:38.211190 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1ce6dfe4-6d74-43e1-abcb-f76866d74b5b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:38.331858 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1ce6dfe4-6d74-43e1-abcb-f76866d74b5b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:38.339628 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1ce6dfe4-6d74-43e1-abcb-f76866d74b5b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:38.341148 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1ce6dfe4-6d74-43e1-abcb-f76866d74b5b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:38.342331 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1ce6dfe4-6d74-43e1-abcb-f76866d74b5b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1721 microversion: 2.20 time: 0.142820 Sep 24 03:37:38.342886 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 483/972] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:38 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:39.364309 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3fab9ac3-6e05-4a5d-9812-b2fc0ebaf0db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:39.364920 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3fab9ac3-6e05-4a5d-9812-b2fc0ebaf0db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:39.371254 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3fab9ac3-6e05-4a5d-9812-b2fc0ebaf0db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:39.371700 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3fab9ac3-6e05-4a5d-9812-b2fc0ebaf0db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:39.372493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3fab9ac3-6e05-4a5d-9812-b2fc0ebaf0db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:39.372921 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3fab9ac3-6e05-4a5d-9812-b2fc0ebaf0db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:39.559949 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3fab9ac3-6e05-4a5d-9812-b2fc0ebaf0db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:39.567597 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3fab9ac3-6e05-4a5d-9812-b2fc0ebaf0db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:39.569089 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3fab9ac3-6e05-4a5d-9812-b2fc0ebaf0db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:39.570293 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3fab9ac3-6e05-4a5d-9812-b2fc0ebaf0db tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1721 microversion: 2.20 time: 0.213480 Sep 24 03:37:39.570860 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 490/973] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:39 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:40.484916 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f548bded-61b3-4799-922a-a2f4f99663e7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:40.486097 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f548bded-61b3-4799-922a-a2f4f99663e7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:40.492269 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f548bded-61b3-4799-922a-a2f4f99663e7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:40.492711 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f548bded-61b3-4799-922a-a2f4f99663e7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:40.493468 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f548bded-61b3-4799-922a-a2f4f99663e7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:40.493937 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f548bded-61b3-4799-922a-a2f4f99663e7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:40.524522 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f548bded-61b3-4799-922a-a2f4f99663e7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043928 Sep 24 03:37:40.525077 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 484/974] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:37:40 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:37:40.588312 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6fd6301f-4265-4b1a-879d-8ea07120c8a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:40.588913 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6fd6301f-4265-4b1a-879d-8ea07120c8a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:40.594871 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6fd6301f-4265-4b1a-879d-8ea07120c8a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:40.595313 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6fd6301f-4265-4b1a-879d-8ea07120c8a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:40.596067 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6fd6301f-4265-4b1a-879d-8ea07120c8a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:40.596495 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6fd6301f-4265-4b1a-879d-8ea07120c8a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:40.720654 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6fd6301f-4265-4b1a-879d-8ea07120c8a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:40.728413 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6fd6301f-4265-4b1a-879d-8ea07120c8a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:40.729981 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6fd6301f-4265-4b1a-879d-8ea07120c8a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:40.731991 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6fd6301f-4265-4b1a-879d-8ea07120c8a7 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1721 microversion: 2.20 time: 0.147131 Sep 24 03:37:40.732565 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 491/975] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:40 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:40.790814 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8326e018-0b42-4f03-9c67-c732c4250c58 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:40.791302 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8326e018-0b42-4f03-9c67-c732c4250c58 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:40.797869 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8326e018-0b42-4f03-9c67-c732c4250c58 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:40.798317 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8326e018-0b42-4f03-9c67-c732c4250c58 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:40.799115 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8326e018-0b42-4f03-9c67-c732c4250c58 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:40.799549 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8326e018-0b42-4f03-9c67-c732c4250c58 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:40.827392 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8326e018-0b42-4f03-9c67-c732c4250c58 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments/bce9deed-a749-491e-b7a4-1e90b86132ae" status: 200 len: 194 microversion: 2.1 time: 0.040462 Sep 24 03:37:40.827968 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 485/976] 10.222.0.18 () {58 vars in 1413 bytes} [Fri Sep 24 03:37:40 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments/bce9deed-a749-491e-b7a4-1e90b86132ae => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:37:40.837153 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-bbab7330-59c4-4ed5-83f2-0b8be682f1d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:40.837636 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-bbab7330-59c4-4ed5-83f2-0b8be682f1d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:40.844339 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bbab7330-59c4-4ed5-83f2-0b8be682f1d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:40.844774 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bbab7330-59c4-4ed5-83f2-0b8be682f1d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:40.845554 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bbab7330-59c4-4ed5-83f2-0b8be682f1d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:40.845999 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-bbab7330-59c4-4ed5-83f2-0b8be682f1d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:40.928135 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.objects.instance [None req-bbab7330-59c4-4ed5-83f2-0b8be682f1d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lazy-loading 'services' on Instance uuid e1ac17a6-46c5-4217-bfc1-b592f3ddd132 {{(pid=109374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:37:40.992886 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-bbab7330-59c4-4ed5-83f2-0b8be682f1d5 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments/bce9deed-a749-491e-b7a4-1e90b86132ae" status: 202 len: 0 microversion: 2.1 time: 0.159226 Sep 24 03:37:40.993467 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 492/977] 10.222.0.18 () {58 vars in 1416 bytes} [Fri Sep 24 03:37:40 2021] DELETE /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments/bce9deed-a749-491e-b7a4-1e90b86132ae => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:37:41.749873 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c80ad44c-ab39-4ab9-b2a1-0bd6d9fe9294 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:41.750470 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c80ad44c-ab39-4ab9-b2a1-0bd6d9fe9294 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:41.756857 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c80ad44c-ab39-4ab9-b2a1-0bd6d9fe9294 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:41.757740 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c80ad44c-ab39-4ab9-b2a1-0bd6d9fe9294 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:41.758587 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c80ad44c-ab39-4ab9-b2a1-0bd6d9fe9294 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:41.759082 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c80ad44c-ab39-4ab9-b2a1-0bd6d9fe9294 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:41.886476 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c80ad44c-ab39-4ab9-b2a1-0bd6d9fe9294 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:41.895154 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c80ad44c-ab39-4ab9-b2a1-0bd6d9fe9294 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:41.896646 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c80ad44c-ab39-4ab9-b2a1-0bd6d9fe9294 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:41.897826 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c80ad44c-ab39-4ab9-b2a1-0bd6d9fe9294 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1724 microversion: 2.20 time: 0.151931 Sep 24 03:37:41.898388 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 486/978] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:41 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:41.916759 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f8d6717a-2236-4a1b-8a64-d1eefb9ca170 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09a36c54-6bc8-4a42-8f1a-d3a44f8463b3"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:41.919097 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f8d6717a-2236-4a1b-8a64-d1eefb9ca170 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:41.925157 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f8d6717a-2236-4a1b-8a64-d1eefb9ca170 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:41.925594 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f8d6717a-2236-4a1b-8a64-d1eefb9ca170 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:41.926382 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f8d6717a-2236-4a1b-8a64-d1eefb9ca170 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:41.926806 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f8d6717a-2236-4a1b-8a64-d1eefb9ca170 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:42.122748 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-74e5ce89-5f49-45d6-a28b-f7fb001e6a84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:42.123237 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-74e5ce89-5f49-45d6-a28b-f7fb001e6a84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:42.129018 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-74e5ce89-5f49-45d6-a28b-f7fb001e6a84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:42.129448 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-74e5ce89-5f49-45d6-a28b-f7fb001e6a84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:42.130252 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-74e5ce89-5f49-45d6-a28b-f7fb001e6a84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:42.130681 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-74e5ce89-5f49-45d6-a28b-f7fb001e6a84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:42.160859 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-74e5ce89-5f49-45d6-a28b-f7fb001e6a84 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments/44c89e73-8daf-45e3-9c1a-44d236c875a1" status: 200 len: 194 microversion: 2.1 time: 0.043152 Sep 24 03:37:42.161441 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 487/979] 10.222.0.18 () {58 vars in 1413 bytes} [Fri Sep 24 03:37:42 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments/44c89e73-8daf-45e3-9c1a-44d236c875a1 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:37:42.171399 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-68d0bc4d-6a72-413e-9975-115e7a1d8735 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:42.171881 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-68d0bc4d-6a72-413e-9975-115e7a1d8735 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:42.177686 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-68d0bc4d-6a72-413e-9975-115e7a1d8735 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:42.178152 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-68d0bc4d-6a72-413e-9975-115e7a1d8735 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:42.178943 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-68d0bc4d-6a72-413e-9975-115e7a1d8735 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:42.179366 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-68d0bc4d-6a72-413e-9975-115e7a1d8735 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:42.197755 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f8d6717a-2236-4a1b-8a64-d1eefb9ca170 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.285145 Sep 24 03:37:42.198365 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 493/980] 10.222.0.18 () {62 vars in 1364 bytes} [Fri Sep 24 03:37:41 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/os-volume_attachments => generated 188 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 03:37:42.261776 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-68d0bc4d-6a72-413e-9975-115e7a1d8735 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lazy-loading 'services' on Instance uuid e1ac17a6-46c5-4217-bfc1-b592f3ddd132 {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:37:42.320974 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-fdc1b17c-3b13-42f2-b123-d36f50c8dd2f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:42.321742 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-fdc1b17c-3b13-42f2-b123-d36f50c8dd2f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:42.327470 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-68d0bc4d-6a72-413e-9975-115e7a1d8735 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments/44c89e73-8daf-45e3-9c1a-44d236c875a1" status: 202 len: 0 microversion: 2.1 time: 0.160163 Sep 24 03:37:42.327629 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fdc1b17c-3b13-42f2-b123-d36f50c8dd2f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:42.327984 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fdc1b17c-3b13-42f2-b123-d36f50c8dd2f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:42.328102 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 488/981] 10.222.0.18 () {58 vars in 1416 bytes} [Fri Sep 24 03:37:42 2021] DELETE /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments/44c89e73-8daf-45e3-9c1a-44d236c875a1 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:37:42.328750 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fdc1b17c-3b13-42f2-b123-d36f50c8dd2f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:42.329153 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fdc1b17c-3b13-42f2-b123-d36f50c8dd2f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:42.578638 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-fdc1b17c-3b13-42f2-b123-d36f50c8dd2f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "DELETE /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/os-volume_attachments/09a36c54-6bc8-4a42-8f1a-d3a44f8463b3" status: 202 len: 0 microversion: 2.20 time: 0.261389 Sep 24 03:37:42.579237 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 494/982] 10.222.0.18 () {60 vars in 1457 bytes} [Fri Sep 24 03:37:42 2021] DELETE /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/os-volume_attachments/09a36c54-6bc8-4a42-8f1a-d3a44f8463b3 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:37:42.637884 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c9c4c772-6f15-49d9-bbba-95f38337a1c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:42.638525 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c9c4c772-6f15-49d9-bbba-95f38337a1c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:42.644468 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c9c4c772-6f15-49d9-bbba-95f38337a1c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:42.645018 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c9c4c772-6f15-49d9-bbba-95f38337a1c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:42.645817 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c9c4c772-6f15-49d9-bbba-95f38337a1c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:42.646250 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c9c4c772-6f15-49d9-bbba-95f38337a1c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:42.724110 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c9c4c772-6f15-49d9-bbba-95f38337a1c8 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action" status: 202 len: 0 microversion: 2.20 time: 0.090772 Sep 24 03:37:42.724910 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 489/983] 10.222.0.18 () {62 vars in 1319 bytes} [Fri Sep 24 03:37:42 2021] POST /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:37:42.733246 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c9ae3835-b27b-4d13-a54b-a5f5f79edf3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:42.734307 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c9ae3835-b27b-4d13-a54b-a5f5f79edf3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:42.740980 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c9ae3835-b27b-4d13-a54b-a5f5f79edf3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:42.741658 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c9ae3835-b27b-4d13-a54b-a5f5f79edf3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:42.742612 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c9ae3835-b27b-4d13-a54b-a5f5f79edf3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:42.743317 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c9ae3835-b27b-4d13-a54b-a5f5f79edf3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:42.893411 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c9ae3835-b27b-4d13-a54b-a5f5f79edf3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:42.901327 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c9ae3835-b27b-4d13-a54b-a5f5f79edf3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:42.903435 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c9ae3835-b27b-4d13-a54b-a5f5f79edf3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:42.904830 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c9ae3835-b27b-4d13-a54b-a5f5f79edf3d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1672 microversion: 2.20 time: 0.175888 Sep 24 03:37:42.905400 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 495/984] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:42 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:43.228032 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-4ebca2e6-823e-498c-973b-e827b86a072f req-869cdee6-85d4-43a4-bc66-03a32d8ad8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722368e5-ae83-4303-be1a-5e1d2d40fe87", "name": "network-vif-unplugged", "status": "completed", "tag": "8c1f1a3d-b239-4f20-8ebe-d00fa864b558"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:37:43.229655 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:37:43.229655 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:37:43.238581 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-4ebca2e6-823e-498c-973b-e827b86a072f req-869cdee6-85d4-43a4-bc66-03a32d8ad8bf service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:43.239239 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-4ebca2e6-823e-498c-973b-e827b86a072f req-869cdee6-85d4-43a4-bc66-03a32d8ad8bf service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:43.253783 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.compute.server_external_events [req-4ebca2e6-823e-498c-973b-e827b86a072f req-869cdee6-85d4-43a4-bc66-03a32d8ad8bf service nova] Unable to find a host for instance 722368e5-ae83-4303-be1a-5e1d2d40fe87. Dropping event network-vif-unplugged {{(pid=109375) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 24 03:37:43.254759 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-4ebca2e6-823e-498c-973b-e827b86a072f req-869cdee6-85d4-43a4-bc66-03a32d8ad8bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031960 Sep 24 03:37:43.255441 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 490/985] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:37:43 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 24 03:37:43.501424 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-07c9a34a-82be-4dd8-8fd6-8bd7e863c33f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:43.502449 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-07c9a34a-82be-4dd8-8fd6-8bd7e863c33f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:43.508388 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-07c9a34a-82be-4dd8-8fd6-8bd7e863c33f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:43.508835 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-07c9a34a-82be-4dd8-8fd6-8bd7e863c33f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:43.509625 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-07c9a34a-82be-4dd8-8fd6-8bd7e863c33f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:43.510081 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-07c9a34a-82be-4dd8-8fd6-8bd7e863c33f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:43.539717 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-07c9a34a-82be-4dd8-8fd6-8bd7e863c33f tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042049 Sep 24 03:37:43.540271 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 496/986] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:37:43 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:37:43.648703 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d89bf0b8-e562-47a6-888d-4ec13b2efa9a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:43.649533 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d89bf0b8-e562-47a6-888d-4ec13b2efa9a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:43.655932 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d89bf0b8-e562-47a6-888d-4ec13b2efa9a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:43.656364 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d89bf0b8-e562-47a6-888d-4ec13b2efa9a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:43.657112 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d89bf0b8-e562-47a6-888d-4ec13b2efa9a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:43.657533 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d89bf0b8-e562-47a6-888d-4ec13b2efa9a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:43.693177 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d89bf0b8-e562-47a6-888d-4ec13b2efa9a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048262 Sep 24 03:37:43.693769 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 491/987] 10.222.0.18 () {58 vars in 1302 bytes} [Fri Sep 24 03:37:43 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 03:37:43.756020 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3561d6b5-ecde-4d6b-bf33-06d0077618f2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:43.756500 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3561d6b5-ecde-4d6b-bf33-06d0077618f2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:43.763010 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3561d6b5-ecde-4d6b-bf33-06d0077618f2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:43.763457 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3561d6b5-ecde-4d6b-bf33-06d0077618f2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:43.764220 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3561d6b5-ecde-4d6b-bf33-06d0077618f2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:43.764648 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3561d6b5-ecde-4d6b-bf33-06d0077618f2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:43.788832 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3561d6b5-ecde-4d6b-bf33-06d0077618f2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Going to try to terminate instance {{(pid=109374) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:37:43.873952 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3561d6b5-ecde-4d6b-bf33-06d0077618f2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 204 len: 0 microversion: 2.1 time: 0.120126 Sep 24 03:37:43.879178 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 497/988] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:37:43 2021] DELETE /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:37:43.885185 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f2537490-9ed9-48e8-a0fb-d2ba617ed385 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:43.886662 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f2537490-9ed9-48e8-a0fb-d2ba617ed385 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:43.894592 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f2537490-9ed9-48e8-a0fb-d2ba617ed385 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:43.895282 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f2537490-9ed9-48e8-a0fb-d2ba617ed385 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:43.896243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f2537490-9ed9-48e8-a0fb-d2ba617ed385 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:43.896665 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f2537490-9ed9-48e8-a0fb-d2ba617ed385 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:43.923620 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c08b558b-3433-4395-a879-78b911934686 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:43.924344 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c08b558b-3433-4395-a879-78b911934686 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:43.930686 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c08b558b-3433-4395-a879-78b911934686 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:43.931371 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c08b558b-3433-4395-a879-78b911934686 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:43.932458 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c08b558b-3433-4395-a879-78b911934686 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:43.933069 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c08b558b-3433-4395-a879-78b911934686 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:44.184168 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-f2537490-9ed9-48e8-a0fb-d2ba617ed385 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:44.192050 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f2537490-9ed9-48e8-a0fb-d2ba617ed385 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.312115 Sep 24 03:37:44.192569 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 492/989] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:43 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:37:44.202415 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c08b558b-3433-4395-a879-78b911934686 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:44.210351 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c08b558b-3433-4395-a879-78b911934686 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:44.211849 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c08b558b-3433-4395-a879-78b911934686 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:44.213018 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c08b558b-3433-4395-a879-78b911934686 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.293706 Sep 24 03:37:44.213583 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 498/990] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:43 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:45.210829 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-cb932377-95f0-454f-b6eb-fc8ff413403b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:45.211454 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-cb932377-95f0-454f-b6eb-fc8ff413403b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:45.217580 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cb932377-95f0-454f-b6eb-fc8ff413403b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:45.218046 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cb932377-95f0-454f-b6eb-fc8ff413403b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:45.218806 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cb932377-95f0-454f-b6eb-fc8ff413403b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:45.219225 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cb932377-95f0-454f-b6eb-fc8ff413403b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:45.235388 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2ef87fbe-766c-429f-b7b0-5e7f3586e95d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:45.235993 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2ef87fbe-766c-429f-b7b0-5e7f3586e95d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:45.241696 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2ef87fbe-766c-429f-b7b0-5e7f3586e95d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:45.242183 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2ef87fbe-766c-429f-b7b0-5e7f3586e95d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:45.242948 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2ef87fbe-766c-429f-b7b0-5e7f3586e95d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:45.243373 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2ef87fbe-766c-429f-b7b0-5e7f3586e95d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:45.394648 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-cb932377-95f0-454f-b6eb-fc8ff413403b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:45.399157 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2ef87fbe-766c-429f-b7b0-5e7f3586e95d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:45.402063 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-cb932377-95f0-454f-b6eb-fc8ff413403b tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.196093 Sep 24 03:37:45.403241 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 493/991] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:45 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:45.406933 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2ef87fbe-766c-429f-b7b0-5e7f3586e95d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:45.408413 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-2ef87fbe-766c-429f-b7b0-5e7f3586e95d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:45.409590 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2ef87fbe-766c-429f-b7b0-5e7f3586e95d tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.181798 Sep 24 03:37:45.410168 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 499/992] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:45 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:46.420831 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-494afafc-0ea4-4872-be72-ce518db0bc6c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:46.421446 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-494afafc-0ea4-4872-be72-ce518db0bc6c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:46.427729 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-494afafc-0ea4-4872-be72-ce518db0bc6c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:46.427930 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a2fa0e40-42c4-4ef8-b2fd-aa71b4ed2efc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:46.428329 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-494afafc-0ea4-4872-be72-ce518db0bc6c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:46.428479 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a2fa0e40-42c4-4ef8-b2fd-aa71b4ed2efc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:46.428920 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-494afafc-0ea4-4872-be72-ce518db0bc6c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:46.429375 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-494afafc-0ea4-4872-be72-ce518db0bc6c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:46.434191 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a2fa0e40-42c4-4ef8-b2fd-aa71b4ed2efc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:46.434627 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a2fa0e40-42c4-4ef8-b2fd-aa71b4ed2efc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:46.435380 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a2fa0e40-42c4-4ef8-b2fd-aa71b4ed2efc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:46.435798 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a2fa0e40-42c4-4ef8-b2fd-aa71b4ed2efc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:46.608557 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-494afafc-0ea4-4872-be72-ce518db0bc6c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:46.611218 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a2fa0e40-42c4-4ef8-b2fd-aa71b4ed2efc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:46.616211 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-494afafc-0ea4-4872-be72-ce518db0bc6c tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.200440 Sep 24 03:37:46.616787 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 494/993] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:46 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:46.618946 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a2fa0e40-42c4-4ef8-b2fd-aa71b4ed2efc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:46.620444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a2fa0e40-42c4-4ef8-b2fd-aa71b4ed2efc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:46.621668 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a2fa0e40-42c4-4ef8-b2fd-aa71b4ed2efc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.197380 Sep 24 03:37:46.622256 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 500/994] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:46 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:47.633182 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-231349f5-c485-4653-9360-eb10aea3abef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:47.633831 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-231349f5-c485-4653-9360-eb10aea3abef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:47.639303 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4c0375d9-0c6f-4955-a675-ee9a34786360 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:47.639903 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4c0375d9-0c6f-4955-a675-ee9a34786360 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:47.640052 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-231349f5-c485-4653-9360-eb10aea3abef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:47.640383 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-231349f5-c485-4653-9360-eb10aea3abef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:47.641447 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-231349f5-c485-4653-9360-eb10aea3abef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:47.642120 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-231349f5-c485-4653-9360-eb10aea3abef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:47.647341 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4c0375d9-0c6f-4955-a675-ee9a34786360 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:47.647341 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4c0375d9-0c6f-4955-a675-ee9a34786360 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:47.647623 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4c0375d9-0c6f-4955-a675-ee9a34786360 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:47.647981 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4c0375d9-0c6f-4955-a675-ee9a34786360 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:47.873863 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-231349f5-c485-4653-9360-eb10aea3abef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:47.877329 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4c0375d9-0c6f-4955-a675-ee9a34786360 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:47.881738 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-231349f5-c485-4653-9360-eb10aea3abef tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.252326 Sep 24 03:37:47.882574 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 495/995] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:47 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:47.895750 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4c0375d9-0c6f-4955-a675-ee9a34786360 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:47.897251 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4c0375d9-0c6f-4955-a675-ee9a34786360 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:47.898463 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4c0375d9-0c6f-4955-a675-ee9a34786360 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.262909 Sep 24 03:37:47.899025 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 501/996] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:47 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:48.899514 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f62049ea-74c2-4a9b-8614-dcaebe761045 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:48.901082 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f62049ea-74c2-4a9b-8614-dcaebe761045 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:48.910965 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f62049ea-74c2-4a9b-8614-dcaebe761045 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:48.917451 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ea9a4b0d-50df-49f4-bbe2-787a522eaa1e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:48.918422 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f62049ea-74c2-4a9b-8614-dcaebe761045 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:48.919296 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ea9a4b0d-50df-49f4-bbe2-787a522eaa1e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:48.919413 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f62049ea-74c2-4a9b-8614-dcaebe761045 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:48.919886 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f62049ea-74c2-4a9b-8614-dcaebe761045 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:48.926158 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ea9a4b0d-50df-49f4-bbe2-787a522eaa1e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:48.926877 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ea9a4b0d-50df-49f4-bbe2-787a522eaa1e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:48.927709 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ea9a4b0d-50df-49f4-bbe2-787a522eaa1e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:48.928251 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ea9a4b0d-50df-49f4-bbe2-787a522eaa1e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:49.107867 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ea9a4b0d-50df-49f4-bbe2-787a522eaa1e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:49.112866 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-f62049ea-74c2-4a9b-8614-dcaebe761045 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:49.119233 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ea9a4b0d-50df-49f4-bbe2-787a522eaa1e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:49.120791 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ea9a4b0d-50df-49f4-bbe2-787a522eaa1e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:49.122925 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ea9a4b0d-50df-49f4-bbe2-787a522eaa1e tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.209317 Sep 24 03:37:49.123403 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f62049ea-74c2-4a9b-8614-dcaebe761045 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.225211 Sep 24 03:37:49.134775 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 502/997] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:48 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:49.135574 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 496/998] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:48 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:50.148267 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2fc7afc1-fd9d-474b-9a38-103b9f734cf3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:50.148977 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2fc7afc1-fd9d-474b-9a38-103b9f734cf3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:50.151423 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-78b3a550-8ec1-4a15-b1a0-89f2144cf4bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:50.152094 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-78b3a550-8ec1-4a15-b1a0-89f2144cf4bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:50.156548 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2fc7afc1-fd9d-474b-9a38-103b9f734cf3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:50.156937 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2fc7afc1-fd9d-474b-9a38-103b9f734cf3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:50.157730 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2fc7afc1-fd9d-474b-9a38-103b9f734cf3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:50.158162 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2fc7afc1-fd9d-474b-9a38-103b9f734cf3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:50.159187 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-78b3a550-8ec1-4a15-b1a0-89f2144cf4bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:50.159637 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-78b3a550-8ec1-4a15-b1a0-89f2144cf4bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:50.160418 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-78b3a550-8ec1-4a15-b1a0-89f2144cf4bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:50.161089 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-78b3a550-8ec1-4a15-b1a0-89f2144cf4bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:50.344470 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2fc7afc1-fd9d-474b-9a38-103b9f734cf3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:50.346256 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-78b3a550-8ec1-4a15-b1a0-89f2144cf4bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:50.352357 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2fc7afc1-fd9d-474b-9a38-103b9f734cf3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.208124 Sep 24 03:37:50.353125 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 497/999] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:50 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:50.355178 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-78b3a550-8ec1-4a15-b1a0-89f2144cf4bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:50.357235 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-78b3a550-8ec1-4a15-b1a0-89f2144cf4bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:50.358522 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-78b3a550-8ec1-4a15-b1a0-89f2144cf4bd tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.218762 Sep 24 03:37:50.359079 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 503/1000] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:50 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:51.370252 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-7e12dbfc-d457-49aa-bcb7-c77787ddf5a2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:51.370947 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-7e12dbfc-d457-49aa-bcb7-c77787ddf5a2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:51.375897 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-02908fc6-2aba-41ce-9470-d2a695806245 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:51.376498 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-02908fc6-2aba-41ce-9470-d2a695806245 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:51.377072 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7e12dbfc-d457-49aa-bcb7-c77787ddf5a2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:51.377509 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7e12dbfc-d457-49aa-bcb7-c77787ddf5a2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:51.378306 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7e12dbfc-d457-49aa-bcb7-c77787ddf5a2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:51.378727 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-7e12dbfc-d457-49aa-bcb7-c77787ddf5a2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:51.382222 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02908fc6-2aba-41ce-9470-d2a695806245 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:51.382669 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02908fc6-2aba-41ce-9470-d2a695806245 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:51.383433 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02908fc6-2aba-41ce-9470-d2a695806245 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:51.383857 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-02908fc6-2aba-41ce-9470-d2a695806245 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:51.571544 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-02908fc6-2aba-41ce-9470-d2a695806245 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:51.574248 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-7e12dbfc-d457-49aa-bcb7-c77787ddf5a2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:51.580180 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-02908fc6-2aba-41ce-9470-d2a695806245 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:51.581677 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-02908fc6-2aba-41ce-9470-d2a695806245 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:51.582281 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-7e12dbfc-d457-49aa-bcb7-c77787ddf5a2 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.215726 Sep 24 03:37:51.582871 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-02908fc6-2aba-41ce-9470-d2a695806245 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.210700 Sep 24 03:37:51.582984 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 498/1001] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:51 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:51.583433 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 504/1002] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:51 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:52.600592 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-cdcbd88f-45e9-417c-84ac-62b259018fb0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:52.601169 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7be8d47c-9903-4c32-90fc-a7f048a46300 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:52.601684 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-7be8d47c-9903-4c32-90fc-a7f048a46300 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:52.602550 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-cdcbd88f-45e9-417c-84ac-62b259018fb0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:52.608925 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7be8d47c-9903-4c32-90fc-a7f048a46300 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:52.609590 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7be8d47c-9903-4c32-90fc-a7f048a46300 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:52.610745 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cdcbd88f-45e9-417c-84ac-62b259018fb0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:52.610893 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7be8d47c-9903-4c32-90fc-a7f048a46300 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:52.611191 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7be8d47c-9903-4c32-90fc-a7f048a46300 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:52.611781 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cdcbd88f-45e9-417c-84ac-62b259018fb0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:52.612664 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cdcbd88f-45e9-417c-84ac-62b259018fb0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:52.613167 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-cdcbd88f-45e9-417c-84ac-62b259018fb0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:52.805408 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-cdcbd88f-45e9-417c-84ac-62b259018fb0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:52.808657 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7be8d47c-9903-4c32-90fc-a7f048a46300 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:52.815494 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-cdcbd88f-45e9-417c-84ac-62b259018fb0 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.219227 Sep 24 03:37:52.816075 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 499/1003] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:52 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:52.818346 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7be8d47c-9903-4c32-90fc-a7f048a46300 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:52.819866 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7be8d47c-9903-4c32-90fc-a7f048a46300 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:52.821016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7be8d47c-9903-4c32-90fc-a7f048a46300 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.223680 Sep 24 03:37:52.821561 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 505/1004] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:52 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:53.834074 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-eefacef0-37ec-4be1-be16-ceedcda65d75 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:53.835189 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-eefacef0-37ec-4be1-be16-ceedcda65d75 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:53.838912 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-49147fc4-4b5f-45e6-ab85-7408f4341963 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:53.840173 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-49147fc4-4b5f-45e6-ab85-7408f4341963 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:53.843751 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-eefacef0-37ec-4be1-be16-ceedcda65d75 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:53.844194 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-eefacef0-37ec-4be1-be16-ceedcda65d75 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:53.844966 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-eefacef0-37ec-4be1-be16-ceedcda65d75 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:53.845392 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-eefacef0-37ec-4be1-be16-ceedcda65d75 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:53.847059 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-49147fc4-4b5f-45e6-ab85-7408f4341963 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:53.847937 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-49147fc4-4b5f-45e6-ab85-7408f4341963 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:53.848919 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-49147fc4-4b5f-45e6-ab85-7408f4341963 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:53.849551 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-49147fc4-4b5f-45e6-ab85-7408f4341963 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:54.031717 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-eefacef0-37ec-4be1-be16-ceedcda65d75 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:54.039668 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-eefacef0-37ec-4be1-be16-ceedcda65d75 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.210608 Sep 24 03:37:54.040385 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 500/1005] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:53 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:54.045263 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-49147fc4-4b5f-45e6-ab85-7408f4341963 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:54.054478 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-49147fc4-4b5f-45e6-ab85-7408f4341963 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:54.056126 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-49147fc4-4b5f-45e6-ab85-7408f4341963 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:54.057395 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-49147fc4-4b5f-45e6-ab85-7408f4341963 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.222488 Sep 24 03:37:54.058083 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 506/1006] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:53 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:55.056330 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-caf09355-a5ef-4626-8a6a-8a06e482dccc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:55.056940 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-caf09355-a5ef-4626-8a6a-8a06e482dccc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:55.063517 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-caf09355-a5ef-4626-8a6a-8a06e482dccc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:55.063965 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-caf09355-a5ef-4626-8a6a-8a06e482dccc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:55.064765 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-caf09355-a5ef-4626-8a6a-8a06e482dccc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:55.065201 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-caf09355-a5ef-4626-8a6a-8a06e482dccc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:55.075788 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5cc3751f-04e3-40b1-b31b-1a0a055b1e9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:55.076991 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5cc3751f-04e3-40b1-b31b-1a0a055b1e9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:55.082882 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5cc3751f-04e3-40b1-b31b-1a0a055b1e9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:55.083325 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5cc3751f-04e3-40b1-b31b-1a0a055b1e9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:55.084087 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5cc3751f-04e3-40b1-b31b-1a0a055b1e9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:55.084511 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5cc3751f-04e3-40b1-b31b-1a0a055b1e9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:55.245639 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-caf09355-a5ef-4626-8a6a-8a06e482dccc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:55.253100 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-caf09355-a5ef-4626-8a6a-8a06e482dccc tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.200433 Sep 24 03:37:55.253676 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 501/1007] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:55 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:37:55.270059 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5cc3751f-04e3-40b1-b31b-1a0a055b1e9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:55.278280 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5cc3751f-04e3-40b1-b31b-1a0a055b1e9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:55.280383 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5cc3751f-04e3-40b1-b31b-1a0a055b1e9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:55.281550 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5cc3751f-04e3-40b1-b31b-1a0a055b1e9c tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.209426 Sep 24 03:37:55.282147 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 507/1008] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:55 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:56.270310 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-150ff2c7-5a52-4c8f-8dd9-e903ba26f11a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:56.270935 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-150ff2c7-5a52-4c8f-8dd9-e903ba26f11a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:56.276756 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-150ff2c7-5a52-4c8f-8dd9-e903ba26f11a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:56.277200 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-150ff2c7-5a52-4c8f-8dd9-e903ba26f11a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:56.277987 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-150ff2c7-5a52-4c8f-8dd9-e903ba26f11a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:56.278413 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-150ff2c7-5a52-4c8f-8dd9-e903ba26f11a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:56.300437 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-05bc78a6-3802-4356-9777-d5895e89b346 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:56.302010 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-05bc78a6-3802-4356-9777-d5895e89b346 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:56.309183 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-05bc78a6-3802-4356-9777-d5895e89b346 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:56.310017 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-05bc78a6-3802-4356-9777-d5895e89b346 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:56.312251 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-05bc78a6-3802-4356-9777-d5895e89b346 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:56.312928 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-05bc78a6-3802-4356-9777-d5895e89b346 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:56.473280 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-150ff2c7-5a52-4c8f-8dd9-e903ba26f11a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:56.480509 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-150ff2c7-5a52-4c8f-8dd9-e903ba26f11a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.213867 Sep 24 03:37:56.481078 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 502/1009] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:56 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:56.487710 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-05bc78a6-3802-4356-9777-d5895e89b346 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:56.496002 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-05bc78a6-3802-4356-9777-d5895e89b346 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:56.497545 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-05bc78a6-3802-4356-9777-d5895e89b346 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:56.499457 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-05bc78a6-3802-4356-9777-d5895e89b346 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.203217 Sep 24 03:37:56.500021 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 508/1010] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:56 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:57.499222 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2a99c825-61b6-4185-be03-f36d776ea099 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:57.499935 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2a99c825-61b6-4185-be03-f36d776ea099 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:57.506242 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2a99c825-61b6-4185-be03-f36d776ea099 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:57.506704 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2a99c825-61b6-4185-be03-f36d776ea099 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:57.507496 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2a99c825-61b6-4185-be03-f36d776ea099 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:57.507928 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2a99c825-61b6-4185-be03-f36d776ea099 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:57.519151 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-caf3644c-d149-4288-8ae4-6c741a68ee20 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:57.521244 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-caf3644c-d149-4288-8ae4-6c741a68ee20 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:57.530371 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-caf3644c-d149-4288-8ae4-6c741a68ee20 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:57.530688 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-caf3644c-d149-4288-8ae4-6c741a68ee20 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:57.531335 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-caf3644c-d149-4288-8ae4-6c741a68ee20 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:57.531771 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-caf3644c-d149-4288-8ae4-6c741a68ee20 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:57.723383 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2a99c825-61b6-4185-be03-f36d776ea099 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:57.730252 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-caf3644c-d149-4288-8ae4-6c741a68ee20 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:57.738958 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2a99c825-61b6-4185-be03-f36d776ea099 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.241671 Sep 24 03:37:57.739522 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 503/1011] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:57 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:57.746319 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-caf3644c-d149-4288-8ae4-6c741a68ee20 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:57.748069 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-caf3644c-d149-4288-8ae4-6c741a68ee20 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:57.749422 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-caf3644c-d149-4288-8ae4-6c741a68ee20 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.236588 Sep 24 03:37:57.750336 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 509/1012] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:57 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:37:58.758071 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e3675d74-022e-4614-aa40-f9a40a97320d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:58.758664 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e3675d74-022e-4614-aa40-f9a40a97320d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:58.764930 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e3675d74-022e-4614-aa40-f9a40a97320d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:58.765365 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e3675d74-022e-4614-aa40-f9a40a97320d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:58.766291 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e3675d74-022e-4614-aa40-f9a40a97320d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:58.766717 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e3675d74-022e-4614-aa40-f9a40a97320d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:58.768549 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-db242d51-976a-4bfb-8e28-5cca846c63cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:58.769376 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-db242d51-976a-4bfb-8e28-5cca846c63cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:37:58.775710 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-db242d51-976a-4bfb-8e28-5cca846c63cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:58.776384 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-db242d51-976a-4bfb-8e28-5cca846c63cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:58.777260 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-db242d51-976a-4bfb-8e28-5cca846c63cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:37:58.777938 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-db242d51-976a-4bfb-8e28-5cca846c63cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:37:58.966053 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e3675d74-022e-4614-aa40-f9a40a97320d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:58.974168 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-db242d51-976a-4bfb-8e28-5cca846c63cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:58.975732 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e3675d74-022e-4614-aa40-f9a40a97320d tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.221242 Sep 24 03:37:58.976568 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 504/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:58 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:37:58.983469 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-db242d51-976a-4bfb-8e28-5cca846c63cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:58.985570 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-db242d51-976a-4bfb-8e28-5cca846c63cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:37:58.986833 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-db242d51-976a-4bfb-8e28-5cca846c63cc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.223417 Sep 24 03:37:58.987412 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 510/1014] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:58 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:37:59.993831 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b32b0f18-137e-4299-a1c5-16eb7537470a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:37:59.994430 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b32b0f18-137e-4299-a1c5-16eb7537470a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:00.000817 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b32b0f18-137e-4299-a1c5-16eb7537470a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:00.001252 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b32b0f18-137e-4299-a1c5-16eb7537470a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:00.002038 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b32b0f18-137e-4299-a1c5-16eb7537470a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:00.002461 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b32b0f18-137e-4299-a1c5-16eb7537470a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:00.005021 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ac02456b-2b69-4b3a-b933-7d44357d2a97 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:00.005656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ac02456b-2b69-4b3a-b933-7d44357d2a97 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:00.011355 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ac02456b-2b69-4b3a-b933-7d44357d2a97 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:00.011799 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ac02456b-2b69-4b3a-b933-7d44357d2a97 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:00.012582 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ac02456b-2b69-4b3a-b933-7d44357d2a97 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:00.013008 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ac02456b-2b69-4b3a-b933-7d44357d2a97 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:00.498510 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b32b0f18-137e-4299-a1c5-16eb7537470a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:00.505842 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b32b0f18-137e-4299-a1c5-16eb7537470a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1672 microversion: 2.1 time: 0.515624 Sep 24 03:38:00.506421 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 505/1015] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:37:59 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1672 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:38:00.514757 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ac02456b-2b69-4b3a-b933-7d44357d2a97 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:00.522610 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ac02456b-2b69-4b3a-b933-7d44357d2a97 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:00.524095 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ac02456b-2b69-4b3a-b933-7d44357d2a97 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:00.525245 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ac02456b-2b69-4b3a-b933-7d44357d2a97 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.524413 Sep 24 03:38:00.525970 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 511/1016] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:37:59 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:38:01.198602 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-0f93f489-c548-4436-8fad-6e814d53cafb req-95872048-8b6a-43c7-b6a2-7dfc805a4de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ac17a6-46c5-4217-bfc1-b592f3ddd132", "name": "network-vif-deleted", "tag": "2a9f0597-3e1c-4f71-8e1d-3016b73e3e60"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:38:01.201603 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:38:01.201603 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:38:01.209795 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-0f93f489-c548-4436-8fad-6e814d53cafb req-95872048-8b6a-43c7-b6a2-7dfc805a4de2 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:01.210548 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-0f93f489-c548-4436-8fad-6e814d53cafb req-95872048-8b6a-43c7-b6a2-7dfc805a4de2 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:01.222252 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-0f93f489-c548-4436-8fad-6e814d53cafb req-95872048-8b6a-43c7-b6a2-7dfc805a4de2 service nova] Creating event network-vif-deleted:2a9f0597-3e1c-4f71-8e1d-3016b73e3e60 for instance e1ac17a6-46c5-4217-bfc1-b592f3ddd132 on hv-cinder-81080 Sep 24 03:38:01.227654 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-0f93f489-c548-4436-8fad-6e814d53cafb req-95872048-8b6a-43c7-b6a2-7dfc805a4de2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032729 Sep 24 03:38:01.228349 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 506/1017] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:38:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:38:01.523126 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c0099872-46e1-435c-a208-c709522fe2a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:01.523704 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c0099872-46e1-435c-a208-c709522fe2a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:01.529506 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c0099872-46e1-435c-a208-c709522fe2a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:01.529979 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c0099872-46e1-435c-a208-c709522fe2a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:01.530746 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c0099872-46e1-435c-a208-c709522fe2a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:01.531180 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c0099872-46e1-435c-a208-c709522fe2a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:01.546841 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-516ed10e-8f24-4c00-919e-ba9f1a285c7a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:01.547723 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-516ed10e-8f24-4c00-919e-ba9f1a285c7a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:01.555261 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-516ed10e-8f24-4c00-919e-ba9f1a285c7a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:01.555817 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-516ed10e-8f24-4c00-919e-ba9f1a285c7a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:01.556828 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-516ed10e-8f24-4c00-919e-ba9f1a285c7a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:01.557358 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-516ed10e-8f24-4c00-919e-ba9f1a285c7a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:01.567566 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c0099872-46e1-435c-a208-c709522fe2a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:01.568221 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c0099872-46e1-435c-a208-c709522fe2a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:01.568841 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.objects.instance [None req-c0099872-46e1-435c-a208-c709522fe2a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lazy-loading 'fault' on Instance uuid e1ac17a6-46c5-4217-bfc1-b592f3ddd132 {{(pid=109374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:38:01.613209 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c0099872-46e1-435c-a208-c709522fe2a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abc927649fe4781829fe7d7b8851333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959a04e215f4456becf31ac01fa6e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:01.623606 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c0099872-46e1-435c-a208-c709522fe2a7 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 200 len: 1327 microversion: 2.1 time: 0.104146 Sep 24 03:38:01.633401 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 512/1018] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:38:01 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:38:01.704475 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-516ed10e-8f24-4c00-919e-ba9f1a285c7a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:01.712434 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-516ed10e-8f24-4c00-919e-ba9f1a285c7a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:01.713961 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-516ed10e-8f24-4c00-919e-ba9f1a285c7a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:01.715134 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-516ed10e-8f24-4c00-919e-ba9f1a285c7a tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.174816 Sep 24 03:38:01.715675 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 507/1019] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:38:01 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:38:02.640988 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-31ce4991-055e-427e-b1da-3fc89ce30c6a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:02.641592 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-31ce4991-055e-427e-b1da-3fc89ce30c6a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:02.647406 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-31ce4991-055e-427e-b1da-3fc89ce30c6a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:02.647851 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-31ce4991-055e-427e-b1da-3fc89ce30c6a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:02.648607 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-31ce4991-055e-427e-b1da-3fc89ce30c6a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:02.649033 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-31ce4991-055e-427e-b1da-3fc89ce30c6a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:02.662218 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-31ce4991-055e-427e-b1da-3fc89ce30c6a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] HTTP exception thrown: Instance e1ac17a6-46c5-4217-bfc1-b592f3ddd132 could not be found. Sep 24 03:38:02.662790 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-31ce4991-055e-427e-b1da-3fc89ce30c6a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Returning 404 to user: Instance e1ac17a6-46c5-4217-bfc1-b592f3ddd132 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:02.663594 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-31ce4991-055e-427e-b1da-3fc89ce30c6a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 404 len: 111 microversion: 2.1 time: 0.027034 Sep 24 03:38:02.664111 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 513/1020] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:38:02 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:38:02.672047 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-14c25469-0357-4b17-95c2-d2dab3bf1c28 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '.version_select at 0x7f66640db550>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:02.689505 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-14c25469-0357-4b17-95c2-d2dab3bf1c28 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-710770459" status: 202 len: 0 microversion: 2.1 time: 0.021003 Sep 24 03:38:02.690092 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 508/1021] 10.222.0.18 () {58 vars in 1218 bytes} [Fri Sep 24 03:38:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-710770459 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:38:02.735016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-87d42114-d0a8-43b4-8010-173f78812dc4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:02.735612 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-87d42114-d0a8-43b4-8010-173f78812dc4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:02.741402 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-87d42114-d0a8-43b4-8010-173f78812dc4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:02.741878 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-87d42114-d0a8-43b4-8010-173f78812dc4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:02.742640 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-87d42114-d0a8-43b4-8010-173f78812dc4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:02.743066 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-87d42114-d0a8-43b4-8010-173f78812dc4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:02.909176 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-87d42114-d0a8-43b4-8010-173f78812dc4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:02.917856 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-87d42114-d0a8-43b4-8010-173f78812dc4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:02.920064 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-87d42114-d0a8-43b4-8010-173f78812dc4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:02.921124 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-87d42114-d0a8-43b4-8010-173f78812dc4 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.191263 Sep 24 03:38:02.921678 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 514/1022] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:38:02 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:38:03.939093 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-c25318b7-553e-4dd8-b875-c5fa2ae008b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:03.939697 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-c25318b7-553e-4dd8-b875-c5fa2ae008b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:03.945563 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c25318b7-553e-4dd8-b875-c5fa2ae008b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:03.946047 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c25318b7-553e-4dd8-b875-c5fa2ae008b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:03.946808 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c25318b7-553e-4dd8-b875-c5fa2ae008b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:03.947235 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-c25318b7-553e-4dd8-b875-c5fa2ae008b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:04.067482 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c25318b7-553e-4dd8-b875-c5fa2ae008b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:04.075111 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c25318b7-553e-4dd8-b875-c5fa2ae008b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:04.076620 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-c25318b7-553e-4dd8-b875-c5fa2ae008b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:04.077808 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-c25318b7-553e-4dd8-b875-c5fa2ae008b2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.142579 Sep 24 03:38:04.078369 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 509/1023] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:38:03 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:38:05.096029 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-224eeb8d-f28a-42b7-8249-221af566fdc2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:05.096566 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-224eeb8d-f28a-42b7-8249-221af566fdc2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:05.102534 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-224eeb8d-f28a-42b7-8249-221af566fdc2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:05.102983 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-224eeb8d-f28a-42b7-8249-221af566fdc2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:05.103751 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-224eeb8d-f28a-42b7-8249-221af566fdc2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:05.104189 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-224eeb8d-f28a-42b7-8249-221af566fdc2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:05.226616 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-224eeb8d-f28a-42b7-8249-221af566fdc2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:05.235162 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-224eeb8d-f28a-42b7-8249-221af566fdc2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:05.236668 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-224eeb8d-f28a-42b7-8249-221af566fdc2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:05.237851 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-224eeb8d-f28a-42b7-8249-221af566fdc2 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.145619 Sep 24 03:38:05.238413 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 515/1024] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:38:05 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:38:05.492362 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-459e93aa-dab6-4056-86ea-8c47740e637f req-b4593f99-587e-438a-bc2d-09c1402c3eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722368e5-ae83-4303-be1a-5e1d2d40fe87", "name": "network-vif-plugged", "status": "completed", "tag": "8c1f1a3d-b239-4f20-8ebe-d00fa864b558"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:38:05.493919 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:38:05.493919 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:38:05.501532 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-459e93aa-dab6-4056-86ea-8c47740e637f req-b4593f99-587e-438a-bc2d-09c1402c3eb1 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:05.501915 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-459e93aa-dab6-4056-86ea-8c47740e637f req-b4593f99-587e-438a-bc2d-09c1402c3eb1 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:05.512988 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-459e93aa-dab6-4056-86ea-8c47740e637f req-b4593f99-587e-438a-bc2d-09c1402c3eb1 service nova] Creating event network-vif-plugged:8c1f1a3d-b239-4f20-8ebe-d00fa864b558 for instance 722368e5-ae83-4303-be1a-5e1d2d40fe87 on hv-cinder-81080 Sep 24 03:38:05.518074 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-459e93aa-dab6-4056-86ea-8c47740e637f req-b4593f99-587e-438a-bc2d-09c1402c3eb1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029290 Sep 24 03:38:05.518661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 510/1025] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:38:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:38:05.630379 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-96daad62-b626-4a5a-b102-173d9efdc02a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:05.630861 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-96daad62-b626-4a5a-b102-173d9efdc02a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:05.636652 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-96daad62-b626-4a5a-b102-173d9efdc02a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:05.637141 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-96daad62-b626-4a5a-b102-173d9efdc02a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:05.637873 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-96daad62-b626-4a5a-b102-173d9efdc02a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:05.638333 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-96daad62-b626-4a5a-b102-173d9efdc02a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:05.651587 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-96daad62-b626-4a5a-b102-173d9efdc02a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] HTTP exception thrown: Instance e1ac17a6-46c5-4217-bfc1-b592f3ddd132 could not be found. Sep 24 03:38:05.652156 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-96daad62-b626-4a5a-b102-173d9efdc02a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Returning 404 to user: Instance e1ac17a6-46c5-4217-bfc1-b592f3ddd132 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:05.652960 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-96daad62-b626-4a5a-b102-173d9efdc02a tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 404 len: 111 microversion: 2.1 time: 0.026382 Sep 24 03:38:05.653496 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 516/1026] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:38:05 2021] DELETE /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:38:05.662531 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d432a838-ba23-4869-99e1-3e77b6a09998 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:05.663312 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d432a838-ba23-4869-99e1-3e77b6a09998 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: e1ac17a6-46c5-4217-bfc1-b592f3ddd132] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:05.670326 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d432a838-ba23-4869-99e1-3e77b6a09998 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:05.671051 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d432a838-ba23-4869-99e1-3e77b6a09998 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:05.671839 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d432a838-ba23-4869-99e1-3e77b6a09998 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:05.672290 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d432a838-ba23-4869-99e1-3e77b6a09998 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:05.686137 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-d432a838-ba23-4869-99e1-3e77b6a09998 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] HTTP exception thrown: Instance e1ac17a6-46c5-4217-bfc1-b592f3ddd132 could not be found. Sep 24 03:38:05.686723 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d432a838-ba23-4869-99e1-3e77b6a09998 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Returning 404 to user: Instance e1ac17a6-46c5-4217-bfc1-b592f3ddd132 could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:05.687623 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d432a838-ba23-4869-99e1-3e77b6a09998 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132" status: 404 len: 111 microversion: 2.1 time: 0.029309 Sep 24 03:38:05.688195 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 511/1027] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:38:05 2021] GET /compute/v2.1/servers/e1ac17a6-46c5-4217-bfc1-b592f3ddd132 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:38:06.256228 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4dd1159b-f4bb-4a29-b0a8-8bcae19a6638 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:06.256831 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-4dd1159b-f4bb-4a29-b0a8-8bcae19a6638 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:06.262742 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4dd1159b-f4bb-4a29-b0a8-8bcae19a6638 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:06.263795 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4dd1159b-f4bb-4a29-b0a8-8bcae19a6638 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:06.264565 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4dd1159b-f4bb-4a29-b0a8-8bcae19a6638 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:06.264995 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-4dd1159b-f4bb-4a29-b0a8-8bcae19a6638 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:06.381245 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4dd1159b-f4bb-4a29-b0a8-8bcae19a6638 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:06.389643 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4dd1159b-f4bb-4a29-b0a8-8bcae19a6638 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:06.391180 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-4dd1159b-f4bb-4a29-b0a8-8bcae19a6638 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:06.392330 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4dd1159b-f4bb-4a29-b0a8-8bcae19a6638 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.139884 Sep 24 03:38:06.392890 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 517/1028] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:38:06 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:38:06.821808 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-46a82435-7c5d-4d79-8028-183fd76f3fa3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:06.822315 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-46a82435-7c5d-4d79-8028-183fd76f3fa3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:06.828113 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-46a82435-7c5d-4d79-8028-183fd76f3fa3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:06.828561 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-46a82435-7c5d-4d79-8028-183fd76f3fa3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:06.829342 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-46a82435-7c5d-4d79-8028-183fd76f3fa3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:06.829929 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-46a82435-7c5d-4d79-8028-183fd76f3fa3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:06.844486 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-46a82435-7c5d-4d79-8028-183fd76f3fa3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] HTTP exception thrown: Instance 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe could not be found. Sep 24 03:38:06.845080 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-46a82435-7c5d-4d79-8028-183fd76f3fa3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Returning 404 to user: Instance 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:06.845938 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-46a82435-7c5d-4d79-8028-183fd76f3fa3 tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 404 len: 111 microversion: 2.1 time: 0.027747 Sep 24 03:38:06.846496 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 512/1029] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:38:06 2021] DELETE /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:38:06.854350 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-00d66a85-4efa-42df-b32f-f0309eb3d1af tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:06.855016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-00d66a85-4efa-42df-b32f-f0309eb3d1af tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] [instance: 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:06.862307 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-00d66a85-4efa-42df-b32f-f0309eb3d1af tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:06.862749 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-00d66a85-4efa-42df-b32f-f0309eb3d1af tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:06.863512 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-00d66a85-4efa-42df-b32f-f0309eb3d1af tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:06.863940 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-00d66a85-4efa-42df-b32f-f0309eb3d1af tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:06.878775 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-00d66a85-4efa-42df-b32f-f0309eb3d1af tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] HTTP exception thrown: Instance 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe could not be found. Sep 24 03:38:06.879393 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-00d66a85-4efa-42df-b32f-f0309eb3d1af tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] Returning 404 to user: Instance 1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:06.880387 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-00d66a85-4efa-42df-b32f-f0309eb3d1af tempest-AttachVolumeTestJSON-1084128314 tempest-AttachVolumeTestJSON-1084128314-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe" status: 404 len: 111 microversion: 2.1 time: 0.029535 Sep 24 03:38:06.880808 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 518/1030] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:38:06 2021] GET /compute/v2.1/servers/1dd83ef7-8c66-45e6-9508-80b2c5b8f9fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:38:07.410130 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8abfe482-3405-4ae3-aaa3-38031b6297fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:07.410824 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8abfe482-3405-4ae3-aaa3-38031b6297fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:07.416590 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8abfe482-3405-4ae3-aaa3-38031b6297fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:07.417099 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8abfe482-3405-4ae3-aaa3-38031b6297fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:07.417951 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8abfe482-3405-4ae3-aaa3-38031b6297fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:07.418446 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8abfe482-3405-4ae3-aaa3-38031b6297fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:07.607624 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8abfe482-3405-4ae3-aaa3-38031b6297fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:07.615671 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8abfe482-3405-4ae3-aaa3-38031b6297fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:07.617281 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8abfe482-3405-4ae3-aaa3-38031b6297fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:07.618558 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8abfe482-3405-4ae3-aaa3-38031b6297fc tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1730 microversion: 2.20 time: 0.212209 Sep 24 03:38:07.619115 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 513/1031] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:38:07 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:38:08.636177 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ec24fb89-bcd8-4f65-b835-04c2eecf2531 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:08.637307 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ec24fb89-bcd8-4f65-b835-04c2eecf2531 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:08.643863 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ec24fb89-bcd8-4f65-b835-04c2eecf2531 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:08.644311 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ec24fb89-bcd8-4f65-b835-04c2eecf2531 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:08.645089 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ec24fb89-bcd8-4f65-b835-04c2eecf2531 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:08.645519 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ec24fb89-bcd8-4f65-b835-04c2eecf2531 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:08.774365 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ec24fb89-bcd8-4f65-b835-04c2eecf2531 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:08.784093 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ec24fb89-bcd8-4f65-b835-04c2eecf2531 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:08.785587 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ec24fb89-bcd8-4f65-b835-04c2eecf2531 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:08.786939 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ec24fb89-bcd8-4f65-b835-04c2eecf2531 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1717 microversion: 2.20 time: 0.154308 Sep 24 03:38:08.787678 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 519/1032] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:38:08 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:38:39.518707 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-505164ff-833f-4b71-b569-7b4615559b06 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:39.519604 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-505164ff-833f-4b71-b569-7b4615559b06 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:39.525497 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-505164ff-833f-4b71-b569-7b4615559b06 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:39.525954 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-505164ff-833f-4b71-b569-7b4615559b06 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:39.526721 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-505164ff-833f-4b71-b569-7b4615559b06 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:39.527140 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-505164ff-833f-4b71-b569-7b4615559b06 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:39.555865 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-505164ff-833f-4b71-b569-7b4615559b06 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041077 Sep 24 03:38:39.556408 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 514/1033] 10.222.0.18 () {60 vars in 1343 bytes} [Fri Sep 24 03:38:39 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:38:39.615368 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8fab4c31-9b3f-44a7-95f6-6f42687b911f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:39.615880 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8fab4c31-9b3f-44a7-95f6-6f42687b911f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:39.621880 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8fab4c31-9b3f-44a7-95f6-6f42687b911f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:39.622322 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8fab4c31-9b3f-44a7-95f6-6f42687b911f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:39.623081 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8fab4c31-9b3f-44a7-95f6-6f42687b911f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:39.624610 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8fab4c31-9b3f-44a7-95f6-6f42687b911f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:39.648595 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8fab4c31-9b3f-44a7-95f6-6f42687b911f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Going to try to terminate instance {{(pid=109374) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:38:39.727649 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8fab4c31-9b3f-44a7-95f6-6f42687b911f tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "DELETE /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 204 len: 0 microversion: 2.20 time: 0.115554 Sep 24 03:38:39.728138 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 520/1034] 10.222.0.18 () {60 vars in 1280 bytes} [Fri Sep 24 03:38:39 2021] DELETE /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 24 03:38:39.737211 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-ea3e43f2-7d10-43a5-b939-ac4d595f7d93 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:39.737858 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-ea3e43f2-7d10-43a5-b939-ac4d595f7d93 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:39.743611 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ea3e43f2-7d10-43a5-b939-ac4d595f7d93 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:39.744052 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ea3e43f2-7d10-43a5-b939-ac4d595f7d93 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:39.744814 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ea3e43f2-7d10-43a5-b939-ac4d595f7d93 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:39.745241 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-ea3e43f2-7d10-43a5-b939-ac4d595f7d93 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:39.866254 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ea3e43f2-7d10-43a5-b939-ac4d595f7d93 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:39.874317 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ea3e43f2-7d10-43a5-b939-ac4d595f7d93 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:39.875816 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-ea3e43f2-7d10-43a5-b939-ac4d595f7d93 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:39.876967 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-ea3e43f2-7d10-43a5-b939-ac4d595f7d93 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.144503 Sep 24 03:38:39.877528 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 515/1035] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:38:39 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 03:38:40.895935 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6a645204-c76b-481b-8952-de7a03489111 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:40.896528 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6a645204-c76b-481b-8952-de7a03489111 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:40.902448 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6a645204-c76b-481b-8952-de7a03489111 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:40.902882 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6a645204-c76b-481b-8952-de7a03489111 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:40.903634 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6a645204-c76b-481b-8952-de7a03489111 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:40.904133 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6a645204-c76b-481b-8952-de7a03489111 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:41.031009 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6a645204-c76b-481b-8952-de7a03489111 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:41.038746 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6a645204-c76b-481b-8952-de7a03489111 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:41.040286 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6a645204-c76b-481b-8952-de7a03489111 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:41.041447 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6a645204-c76b-481b-8952-de7a03489111 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1723 microversion: 2.20 time: 0.149670 Sep 24 03:38:41.042047 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 521/1036] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:38:40 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:38:41.960918 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-dc00c9a9-e961-44d6-b875-3234d846d623 req-ec59c86b-817d-4987-b335-1d5dbe9792e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722368e5-ae83-4303-be1a-5e1d2d40fe87", "name": "network-vif-deleted", "tag": "8c1f1a3d-b239-4f20-8ebe-d00fa864b558"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:38:41.962533 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:38:41.962533 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:38:41.983671 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-dc00c9a9-e961-44d6-b875-3234d846d623 req-ec59c86b-817d-4987-b335-1d5dbe9792e1 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:41.984392 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-dc00c9a9-e961-44d6-b875-3234d846d623 req-ec59c86b-817d-4987-b335-1d5dbe9792e1 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:42.007209 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-dc00c9a9-e961-44d6-b875-3234d846d623 req-ec59c86b-817d-4987-b335-1d5dbe9792e1 service nova] Creating event network-vif-deleted:8c1f1a3d-b239-4f20-8ebe-d00fa864b558 for instance 722368e5-ae83-4303-be1a-5e1d2d40fe87 on hv-cinder-81080 Sep 24 03:38:42.015000 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-dc00c9a9-e961-44d6-b875-3234d846d623 req-ec59c86b-817d-4987-b335-1d5dbe9792e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056192 Sep 24 03:38:42.020555 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 516/1037] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:38:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:38:42.059839 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0d324f57-4681-4095-9900-5849ae9e4e99 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:42.060550 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0d324f57-4681-4095-9900-5849ae9e4e99 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:42.070734 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0d324f57-4681-4095-9900-5849ae9e4e99 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:42.072322 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0d324f57-4681-4095-9900-5849ae9e4e99 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:42.074058 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0d324f57-4681-4095-9900-5849ae9e4e99 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:42.075725 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0d324f57-4681-4095-9900-5849ae9e4e99 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:42.182894 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0d324f57-4681-4095-9900-5849ae9e4e99 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:42.191356 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0d324f57-4681-4095-9900-5849ae9e4e99 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:42.193236 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0d324f57-4681-4095-9900-5849ae9e4e99 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8050cf3919a4e36865457a4c6568339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591aadad4ac440c6afd8189aa7e5cee6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:38:42.194429 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0d324f57-4681-4095-9900-5849ae9e4e99 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 200 len: 1366 microversion: 2.20 time: 0.138722 Sep 24 03:38:42.194988 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 522/1038] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:38:42 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 03:38:43.213407 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2c4efd16-4f92-419c-afb3-f99e53c7687b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:43.214226 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2c4efd16-4f92-419c-afb3-f99e53c7687b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:43.220838 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2c4efd16-4f92-419c-afb3-f99e53c7687b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:43.221417 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2c4efd16-4f92-419c-afb3-f99e53c7687b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:43.222222 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2c4efd16-4f92-419c-afb3-f99e53c7687b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:43.222648 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2c4efd16-4f92-419c-afb3-f99e53c7687b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:43.239370 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-2c4efd16-4f92-419c-afb3-f99e53c7687b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] HTTP exception thrown: Instance 722368e5-ae83-4303-be1a-5e1d2d40fe87 could not be found. Sep 24 03:38:43.240015 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2c4efd16-4f92-419c-afb3-f99e53c7687b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Returning 404 to user: Instance 722368e5-ae83-4303-be1a-5e1d2d40fe87 could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:43.240839 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2c4efd16-4f92-419c-afb3-f99e53c7687b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 404 len: 111 microversion: 2.20 time: 0.031641 Sep 24 03:38:43.241491 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 517/1039] 10.222.0.18 () {60 vars in 1277 bytes} [Fri Sep 24 03:38:43 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 03:38:43.251638 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2995c7d0-0270-4417-bf06-38c881ce38de tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '.version_select at 0x7f665e78a430>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:43.275443 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2995c7d0-0270-4417-bf06-38c881ce38de tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830593475" status: 204 len: 0 microversion: 2.20 time: 0.028775 Sep 24 03:38:43.276122 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 523/1040] 10.222.0.18 () {60 vars in 1262 bytes} [Fri Sep 24 03:38:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830593475 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 03:38:45.056339 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-dbfb1e33-a01d-4b3d-92d5-5426268cbb03 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:45.056832 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-dbfb1e33-a01d-4b3d-92d5-5426268cbb03 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:45.063400 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dbfb1e33-a01d-4b3d-92d5-5426268cbb03 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:45.063843 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dbfb1e33-a01d-4b3d-92d5-5426268cbb03 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:45.064607 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dbfb1e33-a01d-4b3d-92d5-5426268cbb03 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:45.065035 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-dbfb1e33-a01d-4b3d-92d5-5426268cbb03 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:45.078009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-dbfb1e33-a01d-4b3d-92d5-5426268cbb03 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] HTTP exception thrown: Instance 722368e5-ae83-4303-be1a-5e1d2d40fe87 could not be found. Sep 24 03:38:45.078585 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-dbfb1e33-a01d-4b3d-92d5-5426268cbb03 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Returning 404 to user: Instance 722368e5-ae83-4303-be1a-5e1d2d40fe87 could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:45.079416 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-dbfb1e33-a01d-4b3d-92d5-5426268cbb03 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "DELETE /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 404 len: 111 microversion: 2.1 time: 0.026754 Sep 24 03:38:45.079931 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 518/1041] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:38:45 2021] DELETE /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:38:45.087521 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b0a0335c-fc45-4a20-8d6d-4cbaa67a82e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:45.088145 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b0a0335c-fc45-4a20-8d6d-4cbaa67a82e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 722368e5-ae83-4303-be1a-5e1d2d40fe87] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:45.094445 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b0a0335c-fc45-4a20-8d6d-4cbaa67a82e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:45.094884 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b0a0335c-fc45-4a20-8d6d-4cbaa67a82e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:45.095636 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b0a0335c-fc45-4a20-8d6d-4cbaa67a82e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:45.096058 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b0a0335c-fc45-4a20-8d6d-4cbaa67a82e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:45.109843 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-b0a0335c-fc45-4a20-8d6d-4cbaa67a82e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] HTTP exception thrown: Instance 722368e5-ae83-4303-be1a-5e1d2d40fe87 could not be found. Sep 24 03:38:45.110409 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b0a0335c-fc45-4a20-8d6d-4cbaa67a82e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Returning 404 to user: Instance 722368e5-ae83-4303-be1a-5e1d2d40fe87 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:45.111203 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b0a0335c-fc45-4a20-8d6d-4cbaa67a82e1 tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87" status: 404 len: 111 microversion: 2.1 time: 0.027362 Sep 24 03:38:45.111708 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 524/1042] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:38:45 2021] GET /compute/v2.1/servers/722368e5-ae83-4303-be1a-5e1d2d40fe87 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:38:46.243318 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a1a872cd-b032-4a7d-8883-5251e4fe2e3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:46.243810 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a1a872cd-b032-4a7d-8883-5251e4fe2e3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:46.250195 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a1a872cd-b032-4a7d-8883-5251e4fe2e3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:46.250637 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a1a872cd-b032-4a7d-8883-5251e4fe2e3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:46.251400 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a1a872cd-b032-4a7d-8883-5251e4fe2e3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:46.251829 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a1a872cd-b032-4a7d-8883-5251e4fe2e3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:46.264897 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-a1a872cd-b032-4a7d-8883-5251e4fe2e3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] HTTP exception thrown: Instance 3f043b14-af6f-4d95-a094-87fa6c768493 could not be found. Sep 24 03:38:46.265470 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a1a872cd-b032-4a7d-8883-5251e4fe2e3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Returning 404 to user: Instance 3f043b14-af6f-4d95-a094-87fa6c768493 could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:46.266299 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a1a872cd-b032-4a7d-8883-5251e4fe2e3b tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 404 len: 111 microversion: 2.1 time: 0.026729 Sep 24 03:38:46.266816 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 519/1043] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:38:46 2021] DELETE /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:38:46.274406 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-89d496e2-e5d6-4fab-b1cf-379c7fa47bda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:46.275007 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-89d496e2-e5d6-4fab-b1cf-379c7fa47bda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] [instance: 3f043b14-af6f-4d95-a094-87fa6c768493] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:38:46.280898 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-89d496e2-e5d6-4fab-b1cf-379c7fa47bda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:46.281335 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-89d496e2-e5d6-4fab-b1cf-379c7fa47bda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:46.282125 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-89d496e2-e5d6-4fab-b1cf-379c7fa47bda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:38:46.282548 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-89d496e2-e5d6-4fab-b1cf-379c7fa47bda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:38:46.295927 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-89d496e2-e5d6-4fab-b1cf-379c7fa47bda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] HTTP exception thrown: Instance 3f043b14-af6f-4d95-a094-87fa6c768493 could not be found. Sep 24 03:38:46.296492 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-89d496e2-e5d6-4fab-b1cf-379c7fa47bda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] Returning 404 to user: Instance 3f043b14-af6f-4d95-a094-87fa6c768493 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:46.297283 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-89d496e2-e5d6-4fab-b1cf-379c7fa47bda tempest-AttachVolumeShelveTestJSON-256579752 tempest-AttachVolumeShelveTestJSON-256579752-project] 10.222.0.18 "GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493" status: 404 len: 111 microversion: 2.1 time: 0.026581 Sep 24 03:38:46.297804 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 525/1044] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:38:46 2021] GET /compute/v2.1/servers/3f043b14-af6f-4d95-a094-87fa6c768493 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 03:38:50.918378 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-037ddfd1-cb5e-4d7a-8d3b-988c3de64937 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Action: 'create', calling method: .version_select at 0x7f6664229430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2116210590"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:38:51.196032 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-037ddfd1-cb5e-4d7a-8d3b-988c3de64937 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.390356 Sep 24 03:38:51.196658 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 520/1045] 10.222.0.18 () {60 vars in 1155 bytes} [Fri Sep 24 03:38:50 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 392 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 24 03:38:51.207735 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a698ddd7-29e2-4310-b40d-3b40b2713cd2 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f665e7e0430>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:51.263784 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a698ddd7-29e2-4310-b40d-3b40b2713cd2 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/df0962c5-7058-4df2-9af2-931d760f534e" status: 200 len: 345 microversion: 2.1 time: 0.059520 Sep 24 03:38:51.264693 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 526/1046] 10.222.0.18 () {58 vars in 1245 bytes} [Fri Sep 24 03:38:51 2021] GET /compute/v2.1/os-volumes/df0962c5-7058-4df2-9af2-931d760f534e => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:38:52.275362 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5d95cd87-c456-4768-88f7-35324db3c380 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f66640db550>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:52.325455 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5d95cd87-c456-4768-88f7-35324db3c380 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/df0962c5-7058-4df2-9af2-931d760f534e" status: 200 len: 346 microversion: 2.1 time: 0.053660 Sep 24 03:38:52.326571 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 521/1047] 10.222.0.18 () {58 vars in 1245 bytes} [Fri Sep 24 03:38:52 2021] GET /compute/v2.1/os-volumes/df0962c5-7058-4df2-9af2-931d760f534e => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:38:52.337286 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ef2d96ea-9bec-4200-b850-3ff1ace200d8 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Action: 'create', calling method: .version_select at 0x7f666408ddc0>, body: {"snapshot": {"volume_id": "df0962c5-7058-4df2-9af2-931d760f534e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-647234248"}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:38:52.471308 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ef2d96ea-9bec-4200-b850-3ff1ace200d8 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.137516 Sep 24 03:38:52.471888 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 527/1048] 10.222.0.18 () {60 vars in 1162 bytes} [Fri Sep 24 03:38:52 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:38:52.481224 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-bbf18404-b442-45e2-8e19-5997d9ff8936 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f66640c8d30>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:52.514069 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-bbf18404-b442-45e2-8e19-5997d9ff8936 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7" status: 200 len: 286 microversion: 2.1 time: 0.036387 Sep 24 03:38:52.514632 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 522/1049] 10.222.0.18 () {58 vars in 1251 bytes} [Fri Sep 24 03:38:52 2021] GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:38:52.524250 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-bb765fe3-20b1-4069-8bfb-9b6d1c24d593 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f666402f820>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:52.554116 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-bb765fe3-20b1-4069-8bfb-9b6d1c24d593 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033516 Sep 24 03:38:52.554675 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 528/1050] 10.222.0.18 () {58 vars in 1140 bytes} [Fri Sep 24 03:38:52 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:38:52.565396 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f6a9f847-747e-4604-8c19-9d27ccf8b4b1 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f6664229430>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:52.594885 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f6a9f847-747e-4604-8c19-9d27ccf8b4b1 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7" status: 200 len: 286 microversion: 2.1 time: 0.034168 Sep 24 03:38:52.595441 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 523/1051] 10.222.0.18 () {58 vars in 1251 bytes} [Fri Sep 24 03:38:52 2021] GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:38:53.606360 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-735804c9-4c34-43a2-8bd9-930542490c17 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f666402fb80>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:53.635518 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-735804c9-4c34-43a2-8bd9-930542490c17 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7" status: 200 len: 286 microversion: 2.1 time: 0.032817 Sep 24 03:38:53.636073 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 529/1052] 10.222.0.18 () {58 vars in 1251 bytes} [Fri Sep 24 03:38:53 2021] GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:38:54.646750 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b82a0809-4e05-4933-9fe3-8e77e4ac07dd tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f6664262310>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:54.675466 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b82a0809-4e05-4933-9fe3-8e77e4ac07dd tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7" status: 200 len: 286 microversion: 2.1 time: 0.032317 Sep 24 03:38:54.676043 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 524/1053] 10.222.0.18 () {58 vars in 1251 bytes} [Fri Sep 24 03:38:54 2021] GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:38:55.687530 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-71a9ce86-781e-4df8-b3fd-fa6f890769e5 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f665e7e0700>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:55.718044 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-71a9ce86-781e-4df8-b3fd-fa6f890769e5 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7" status: 200 len: 287 microversion: 2.1 time: 0.034639 Sep 24 03:38:55.718643 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 530/1054] 10.222.0.18 () {58 vars in 1251 bytes} [Fri Sep 24 03:38:55 2021] GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:38:55.728485 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-803affdf-cb0b-4986-a207-825ae657f862 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f66640c84c0>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:55.781557 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-803affdf-cb0b-4986-a207-825ae657f862 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7" status: 202 len: 0 microversion: 2.1 time: 0.056724 Sep 24 03:38:55.782173 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 525/1055] 10.222.0.18 () {58 vars in 1254 bytes} [Fri Sep 24 03:38:55 2021] DELETE /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:38:55.790363 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-05057d1e-3724-428c-97ed-097a26e31bd6 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f666408d550>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:55.818375 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-05057d1e-3724-428c-97ed-097a26e31bd6 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7" status: 200 len: 286 microversion: 2.1 time: 0.031657 Sep 24 03:38:55.818923 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 531/1056] 10.222.0.18 () {58 vars in 1251 bytes} [Fri Sep 24 03:38:55 2021] GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:38:56.830169 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-20bdaadd-c4e7-44a4-ae56-4522974eee16 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f66640db280>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:56.854714 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-20bdaadd-c4e7-44a4-ae56-4522974eee16 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] HTTP exception thrown: Snapshot 8e43e704-e6d7-4790-9dc2-4174155b15c7 could not be found. Sep 24 03:38:56.855307 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-20bdaadd-c4e7-44a4-ae56-4522974eee16 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Returning 404 to user: Snapshot 8e43e704-e6d7-4790-9dc2-4174155b15c7 could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:56.856122 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-20bdaadd-c4e7-44a4-ae56-4522974eee16 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7" status: 404 len: 111 microversion: 2.1 time: 0.030345 Sep 24 03:38:56.856657 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 526/1057] 10.222.0.18 () {58 vars in 1251 bytes} [Fri Sep 24 03:38:56 2021] GET /compute/v2.1/os-snapshots/8e43e704-e6d7-4790-9dc2-4174155b15c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:38:56.864785 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5f0874c1-0e9b-4a99-a8f6-89b7768f6250 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f665e78a940>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:56.930598 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5f0874c1-0e9b-4a99-a8f6-89b7768f6250 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/df0962c5-7058-4df2-9af2-931d760f534e" status: 202 len: 0 microversion: 2.1 time: 0.069263 Sep 24 03:38:56.931630 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 532/1058] 10.222.0.18 () {58 vars in 1248 bytes} [Fri Sep 24 03:38:56 2021] DELETE /compute/v2.1/os-volumes/df0962c5-7058-4df2-9af2-931d760f534e => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:38:56.940478 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-04f545c1-4c20-4757-ad0b-07b80739286c tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f66640dbaf0>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:57.137005 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-04f545c1-4c20-4757-ad0b-07b80739286c tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] HTTP exception thrown: Volume df0962c5-7058-4df2-9af2-931d760f534e could not be found. Sep 24 03:38:57.137598 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-04f545c1-4c20-4757-ad0b-07b80739286c tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Returning 404 to user: Volume df0962c5-7058-4df2-9af2-931d760f534e could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:57.138444 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-04f545c1-4c20-4757-ad0b-07b80739286c tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/df0962c5-7058-4df2-9af2-931d760f534e" status: 404 len: 109 microversion: 2.1 time: 0.202301 Sep 24 03:38:57.138979 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 527/1059] 10.222.0.18 () {58 vars in 1245 bytes} [Fri Sep 24 03:38:56 2021] GET /compute/v2.1/os-volumes/df0962c5-7058-4df2-9af2-931d760f534e => generated 109 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:38:57.149197 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b4d65132-291c-4958-b239-15b1dec84b12 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f666408da60>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:57.176400 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-b4d65132-291c-4958-b239-15b1dec84b12 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] HTTP exception thrown: Volume df0962c5-7058-4df2-9af2-931d760f534e could not be found. Sep 24 03:38:57.177115 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b4d65132-291c-4958-b239-15b1dec84b12 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Returning 404 to user: Volume df0962c5-7058-4df2-9af2-931d760f534e could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:57.178060 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b4d65132-291c-4958-b239-15b1dec84b12 tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/df0962c5-7058-4df2-9af2-931d760f534e" status: 404 len: 109 microversion: 2.1 time: 0.033375 Sep 24 03:38:57.178688 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 533/1060] 10.222.0.18 () {58 vars in 1248 bytes} [Fri Sep 24 03:38:57 2021] DELETE /compute/v2.1/os-volumes/df0962c5-7058-4df2-9af2-931d760f534e => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 03:38:57.188950 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3380f25e-0589-41ad-a43b-6185eb28937a tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Calling method '.version_select at 0x7f66640c8040>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:57.216118 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-3380f25e-0589-41ad-a43b-6185eb28937a tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] HTTP exception thrown: Volume df0962c5-7058-4df2-9af2-931d760f534e could not be found. Sep 24 03:38:57.216710 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3380f25e-0589-41ad-a43b-6185eb28937a tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] Returning 404 to user: Volume df0962c5-7058-4df2-9af2-931d760f534e could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:38:57.217531 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3380f25e-0589-41ad-a43b-6185eb28937a tempest-VolumesSnapshotsTestJSON-1820986658 tempest-VolumesSnapshotsTestJSON-1820986658-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/df0962c5-7058-4df2-9af2-931d760f534e" status: 404 len: 109 microversion: 2.1 time: 0.033592 Sep 24 03:38:57.218123 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 528/1061] 10.222.0.18 () {58 vars in 1245 bytes} [Fri Sep 24 03:38:57 2021] GET /compute/v2.1/os-volumes/df0962c5-7058-4df2-9af2-931d760f534e => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:38:58.817176 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-83e1058f-81ea-48a5-b8b3-c662ec94be55 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] Action: 'create', calling method: .version_select at 0x7f665e7e0f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-718457911", "metadata": {"Type": "work"}}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:38:59.221676 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-83e1058f-81ea-48a5-b8b3-c662ec94be55 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.536369 Sep 24 03:38:59.222319 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 534/1062] 10.222.0.18 () {60 vars in 1156 bytes} [Fri Sep 24 03:38:58 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 538 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 24 03:38:59.234868 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-013e09f3-3d09-4782-b806-3ceb022e9eb5 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] Calling method '.version_select at 0x7f666415df70>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:38:59.289301 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-013e09f3-3d09-4782-b806-3ceb022e9eb5 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f5244fc2-9ed5-4041-8b66-f90ee0062a60" status: 200 len: 352 microversion: 2.1 time: 0.059463 Sep 24 03:38:59.290063 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 529/1063] 10.222.0.18 () {58 vars in 1245 bytes} [Fri Sep 24 03:38:59 2021] GET /compute/v2.1/os-volumes/f5244fc2-9ed5-4041-8b66-f90ee0062a60 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:39:00.302758 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-60ffe587-8e18-44af-9ced-9bbb82564b76 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] Calling method '.version_select at 0x7f666406aca0>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:00.360716 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-60ffe587-8e18-44af-9ced-9bbb82564b76 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f5244fc2-9ed5-4041-8b66-f90ee0062a60" status: 200 len: 353 microversion: 2.1 time: 0.061886 Sep 24 03:39:00.361695 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 535/1064] 10.222.0.18 () {58 vars in 1245 bytes} [Fri Sep 24 03:39:00 2021] GET /compute/v2.1/os-volumes/f5244fc2-9ed5-4041-8b66-f90ee0062a60 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:39:00.372127 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1bb33549-f201-4c60-b9e4-fe8936c217f9 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] Calling method '.version_select at 0x7f66641961f0>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:00.429261 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1bb33549-f201-4c60-b9e4-fe8936c217f9 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f5244fc2-9ed5-4041-8b66-f90ee0062a60" status: 200 len: 353 microversion: 2.1 time: 0.060881 Sep 24 03:39:00.430497 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 530/1065] 10.222.0.18 () {58 vars in 1245 bytes} [Fri Sep 24 03:39:00 2021] GET /compute/v2.1/os-volumes/f5244fc2-9ed5-4041-8b66-f90ee0062a60 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:39:00.445703 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-4e11bbc6-9505-4475-b558-f492e356cfc0 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] Calling method '.version_select at 0x7f665e7e09d0>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:00.509476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-4e11bbc6-9505-4475-b558-f492e356cfc0 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/f5244fc2-9ed5-4041-8b66-f90ee0062a60" status: 202 len: 0 microversion: 2.1 time: 0.067163 Sep 24 03:39:00.510389 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 536/1066] 10.222.0.18 () {58 vars in 1248 bytes} [Fri Sep 24 03:39:00 2021] DELETE /compute/v2.1/os-volumes/f5244fc2-9ed5-4041-8b66-f90ee0062a60 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:39:00.520223 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-0002f608-5716-4060-b595-87dfe99f7a3f tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] Calling method '.version_select at 0x7f6664183790>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:00.580322 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-0002f608-5716-4060-b595-87dfe99f7a3f tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f5244fc2-9ed5-4041-8b66-f90ee0062a60" status: 200 len: 352 microversion: 2.1 time: 0.065870 Sep 24 03:39:00.585100 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 531/1067] 10.222.0.18 () {58 vars in 1245 bytes} [Fri Sep 24 03:39:00 2021] GET /compute/v2.1/os-volumes/f5244fc2-9ed5-4041-8b66-f90ee0062a60 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:39:01.592906 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a72dd86c-dcc2-423e-ac0b-595f1196e4e0 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] Calling method '.version_select at 0x7f666408d700>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:01.622785 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-a72dd86c-dcc2-423e-ac0b-595f1196e4e0 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] HTTP exception thrown: Volume f5244fc2-9ed5-4041-8b66-f90ee0062a60 could not be found. Sep 24 03:39:01.623570 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a72dd86c-dcc2-423e-ac0b-595f1196e4e0 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] Returning 404 to user: Volume f5244fc2-9ed5-4041-8b66-f90ee0062a60 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:39:01.625589 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a72dd86c-dcc2-423e-ac0b-595f1196e4e0 tempest-VolumesGetTestJSON-886714544 tempest-VolumesGetTestJSON-886714544-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f5244fc2-9ed5-4041-8b66-f90ee0062a60" status: 404 len: 109 microversion: 2.1 time: 0.037109 Sep 24 03:39:01.626327 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 537/1068] 10.222.0.18 () {58 vars in 1245 bytes} [Fri Sep 24 03:39:01 2021] GET /compute/v2.1/os-volumes/f5244fc2-9ed5-4041-8b66-f90ee0062a60 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:39:07.266142 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-af3b789e-a8d4-4572-805b-8034739e6126 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Action: 'create', calling method: .version_select at 0x7f66642295e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1127999244"}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:39:07.287507 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-af3b789e-a8d4-4572-805b-8034739e6126 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Getting quotas for project 6dfe51f1a692492e80a0c7c5a9078e73. Resources: {'key_pairs'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:39:07.291325 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-af3b789e-a8d4-4572-805b-8034739e6126 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Getting quotas for user 9ee5b6094e3b48739df3c797dfcc4edc and project 6dfe51f1a692492e80a0c7c5a9078e73. Resources: {'key_pairs'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:39:07.408938 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-af3b789e-a8d4-4572-805b-8034739e6126 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Getting quotas for project 6dfe51f1a692492e80a0c7c5a9078e73. Resources: {'key_pairs'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:39:07.414000 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-af3b789e-a8d4-4572-805b-8034739e6126 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Getting quotas for user 9ee5b6094e3b48739df3c797dfcc4edc and project 6dfe51f1a692492e80a0c7c5a9078e73. Resources: {'key_pairs'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:39:07.432034 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-af3b789e-a8d4-4572-805b-8034739e6126 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.355972 Sep 24 03:39:07.433285 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 532/1069] 10.222.0.18 () {60 vars in 1158 bytes} [Fri Sep 24 03:39:07 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:39:16.740043 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7e935333-9b86-4f78-8a50-c5e58215cd47 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:39:16.740568 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-7e935333-9b86-4f78-8a50-c5e58215cd47 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:16.746705 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7e935333-9b86-4f78-8a50-c5e58215cd47 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:16.747154 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7e935333-9b86-4f78-8a50-c5e58215cd47 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:16.747922 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7e935333-9b86-4f78-8a50-c5e58215cd47 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:16.748910 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7e935333-9b86-4f78-8a50-c5e58215cd47 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:16.771725 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.objects.instance [None req-7e935333-9b86-4f78-8a50-c5e58215cd47 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lazy-loading 'flavor' on Instance uuid 8a23918f-1f46-46ff-8559-df4e0d82e8d3 {{(pid=109374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:39:16.840268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7e935333-9b86-4f78-8a50-c5e58215cd47 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "POST /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3/action" status: 202 len: 0 microversion: 2.1 time: 0.103740 Sep 24 03:39:16.840841 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 538/1070] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:39:16 2021] POST /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:39:16.849816 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-19af61f3-060c-4715-a75e-66451f17d963 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:16.850517 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-19af61f3-060c-4715-a75e-66451f17d963 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:16.857486 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-19af61f3-060c-4715-a75e-66451f17d963 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:16.858898 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-19af61f3-060c-4715-a75e-66451f17d963 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:16.860427 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-19af61f3-060c-4715-a75e-66451f17d963 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:16.861051 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-19af61f3-060c-4715-a75e-66451f17d963 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:16.995186 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-19af61f3-060c-4715-a75e-66451f17d963 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:17.003141 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-19af61f3-060c-4715-a75e-66451f17d963 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.157835 Sep 24 03:39:17.003706 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 533/1071] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:16 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:18.021304 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-14685fda-5d29-46bc-8e8a-1425b45f8f3d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:18.022033 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-14685fda-5d29-46bc-8e8a-1425b45f8f3d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:18.027956 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-14685fda-5d29-46bc-8e8a-1425b45f8f3d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:18.028401 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-14685fda-5d29-46bc-8e8a-1425b45f8f3d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:18.029160 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-14685fda-5d29-46bc-8e8a-1425b45f8f3d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:18.030236 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-14685fda-5d29-46bc-8e8a-1425b45f8f3d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:18.150159 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-14685fda-5d29-46bc-8e8a-1425b45f8f3d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:18.158104 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-14685fda-5d29-46bc-8e8a-1425b45f8f3d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.140733 Sep 24 03:39:18.158675 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 539/1072] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:18 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:19.177502 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-097ef42d-df81-481e-8bbd-854abbb98784 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:19.178695 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-097ef42d-df81-481e-8bbd-854abbb98784 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:19.185022 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-097ef42d-df81-481e-8bbd-854abbb98784 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:19.185477 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-097ef42d-df81-481e-8bbd-854abbb98784 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:19.186915 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-097ef42d-df81-481e-8bbd-854abbb98784 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:19.187504 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-097ef42d-df81-481e-8bbd-854abbb98784 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:19.338038 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-097ef42d-df81-481e-8bbd-854abbb98784 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:19.345958 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-097ef42d-df81-481e-8bbd-854abbb98784 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.172206 Sep 24 03:39:19.346528 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 534/1073] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:19 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:20.363444 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-30f77978-4787-4b34-8138-6ca9602962b8 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:20.364071 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-30f77978-4787-4b34-8138-6ca9602962b8 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:20.369725 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30f77978-4787-4b34-8138-6ca9602962b8 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:20.370180 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30f77978-4787-4b34-8138-6ca9602962b8 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:20.370951 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30f77978-4787-4b34-8138-6ca9602962b8 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:20.371368 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30f77978-4787-4b34-8138-6ca9602962b8 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:20.505108 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-30f77978-4787-4b34-8138-6ca9602962b8 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:20.512666 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-30f77978-4787-4b34-8138-6ca9602962b8 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.152871 Sep 24 03:39:20.513245 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 540/1074] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:20 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:21.529942 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-4db4cc84-a085-47ae-857b-cf7960ad272d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:21.530543 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-4db4cc84-a085-47ae-857b-cf7960ad272d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:21.538879 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4db4cc84-a085-47ae-857b-cf7960ad272d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:21.539318 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4db4cc84-a085-47ae-857b-cf7960ad272d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:21.540080 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4db4cc84-a085-47ae-857b-cf7960ad272d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:21.540504 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4db4cc84-a085-47ae-857b-cf7960ad272d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:21.662829 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4db4cc84-a085-47ae-857b-cf7960ad272d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:21.670068 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-4db4cc84-a085-47ae-857b-cf7960ad272d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.143660 Sep 24 03:39:21.670633 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 535/1075] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:21 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:22.686990 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-fcefc8b4-79ed-4666-bd53-d80c50124c8d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:22.688381 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-fcefc8b4-79ed-4666-bd53-d80c50124c8d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:22.694178 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fcefc8b4-79ed-4666-bd53-d80c50124c8d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:22.694625 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fcefc8b4-79ed-4666-bd53-d80c50124c8d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:22.695489 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fcefc8b4-79ed-4666-bd53-d80c50124c8d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:22.695943 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-fcefc8b4-79ed-4666-bd53-d80c50124c8d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:22.827220 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-fcefc8b4-79ed-4666-bd53-d80c50124c8d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:22.835456 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-fcefc8b4-79ed-4666-bd53-d80c50124c8d tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.152092 Sep 24 03:39:22.836036 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 541/1076] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:22 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:23.852015 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6df70cb7-b1f3-4bd6-984c-6cd9361a5d31 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:23.852592 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6df70cb7-b1f3-4bd6-984c-6cd9361a5d31 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:23.858665 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6df70cb7-b1f3-4bd6-984c-6cd9361a5d31 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:23.859241 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6df70cb7-b1f3-4bd6-984c-6cd9361a5d31 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:23.860007 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6df70cb7-b1f3-4bd6-984c-6cd9361a5d31 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:23.860435 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6df70cb7-b1f3-4bd6-984c-6cd9361a5d31 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:23.982827 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6df70cb7-b1f3-4bd6-984c-6cd9361a5d31 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:23.990661 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6df70cb7-b1f3-4bd6-984c-6cd9361a5d31 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.142286 Sep 24 03:39:23.991237 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 536/1077] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:23 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:25.008082 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-05b289ac-e443-4012-b27d-f9cba984c875 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:25.008682 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-05b289ac-e443-4012-b27d-f9cba984c875 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:25.014777 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-05b289ac-e443-4012-b27d-f9cba984c875 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:25.015432 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-05b289ac-e443-4012-b27d-f9cba984c875 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:25.016016 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-05b289ac-e443-4012-b27d-f9cba984c875 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:25.016437 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-05b289ac-e443-4012-b27d-f9cba984c875 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:25.142724 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-05b289ac-e443-4012-b27d-f9cba984c875 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:25.149980 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-05b289ac-e443-4012-b27d-f9cba984c875 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.145544 Sep 24 03:39:25.150634 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 542/1078] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:25 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:26.167864 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a50df82b-acaa-41e2-9992-b5fce11484f4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:26.168573 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a50df82b-acaa-41e2-9992-b5fce11484f4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:26.174911 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a50df82b-acaa-41e2-9992-b5fce11484f4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:26.175349 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a50df82b-acaa-41e2-9992-b5fce11484f4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:26.176108 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a50df82b-acaa-41e2-9992-b5fce11484f4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:26.176534 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a50df82b-acaa-41e2-9992-b5fce11484f4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:26.298652 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a50df82b-acaa-41e2-9992-b5fce11484f4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:26.305912 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a50df82b-acaa-41e2-9992-b5fce11484f4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.141624 Sep 24 03:39:26.306481 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 537/1079] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:26 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:27.322689 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-f67d5d10-c6cc-4c44-87c8-6e07efb56cb4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:27.323281 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-f67d5d10-c6cc-4c44-87c8-6e07efb56cb4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:27.330241 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f67d5d10-c6cc-4c44-87c8-6e07efb56cb4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:27.330679 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f67d5d10-c6cc-4c44-87c8-6e07efb56cb4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:27.331428 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f67d5d10-c6cc-4c44-87c8-6e07efb56cb4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:27.331847 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-f67d5d10-c6cc-4c44-87c8-6e07efb56cb4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:27.452914 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-f67d5d10-c6cc-4c44-87c8-6e07efb56cb4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:27.460313 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-f67d5d10-c6cc-4c44-87c8-6e07efb56cb4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.141426 Sep 24 03:39:27.460879 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 543/1080] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:27 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:28.475943 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b68a7306-7ebe-47ee-85b1-0db77ad11ad7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:28.476535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b68a7306-7ebe-47ee-85b1-0db77ad11ad7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:28.482417 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b68a7306-7ebe-47ee-85b1-0db77ad11ad7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:28.482907 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b68a7306-7ebe-47ee-85b1-0db77ad11ad7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:28.483891 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b68a7306-7ebe-47ee-85b1-0db77ad11ad7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:28.484901 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b68a7306-7ebe-47ee-85b1-0db77ad11ad7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:28.672739 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b68a7306-7ebe-47ee-85b1-0db77ad11ad7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:28.680176 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b68a7306-7ebe-47ee-85b1-0db77ad11ad7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.207754 Sep 24 03:39:28.680757 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 538/1081] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:28 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:29.700149 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5b4de29e-2e16-4368-93ca-7d8851d7d53e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:29.700685 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5b4de29e-2e16-4368-93ca-7d8851d7d53e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:29.707288 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5b4de29e-2e16-4368-93ca-7d8851d7d53e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:29.707728 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5b4de29e-2e16-4368-93ca-7d8851d7d53e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:29.708493 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5b4de29e-2e16-4368-93ca-7d8851d7d53e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:29.708917 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5b4de29e-2e16-4368-93ca-7d8851d7d53e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:29.863999 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5b4de29e-2e16-4368-93ca-7d8851d7d53e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:29.871380 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5b4de29e-2e16-4368-93ca-7d8851d7d53e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.175092 Sep 24 03:39:29.871951 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 544/1082] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:29 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:30.888092 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5ac50623-ddf3-424e-bc16-7c6433f29b8c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:30.888649 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5ac50623-ddf3-424e-bc16-7c6433f29b8c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:30.895128 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5ac50623-ddf3-424e-bc16-7c6433f29b8c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:30.895587 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5ac50623-ddf3-424e-bc16-7c6433f29b8c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:30.896326 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5ac50623-ddf3-424e-bc16-7c6433f29b8c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:30.896751 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5ac50623-ddf3-424e-bc16-7c6433f29b8c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:31.020235 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5ac50623-ddf3-424e-bc16-7c6433f29b8c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:31.027536 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5ac50623-ddf3-424e-bc16-7c6433f29b8c tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.143306 Sep 24 03:39:31.028123 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 539/1083] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:30 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:32.045514 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-03469479-4fb8-470f-8453-634fe52c6ca6 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:32.046136 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-03469479-4fb8-470f-8453-634fe52c6ca6 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:32.052348 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-03469479-4fb8-470f-8453-634fe52c6ca6 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:32.053079 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-03469479-4fb8-470f-8453-634fe52c6ca6 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:32.053867 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-03469479-4fb8-470f-8453-634fe52c6ca6 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:32.054307 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-03469479-4fb8-470f-8453-634fe52c6ca6 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:32.243961 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-03469479-4fb8-470f-8453-634fe52c6ca6 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:32.251929 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-03469479-4fb8-470f-8453-634fe52c6ca6 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.210127 Sep 24 03:39:32.252495 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 545/1084] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:32 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:39:33.268769 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8d0f0c67-8685-4b73-aa33-bbb0b60ece94 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:33.269370 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8d0f0c67-8685-4b73-aa33-bbb0b60ece94 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:33.275267 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8d0f0c67-8685-4b73-aa33-bbb0b60ece94 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:33.275697 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8d0f0c67-8685-4b73-aa33-bbb0b60ece94 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:33.276454 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8d0f0c67-8685-4b73-aa33-bbb0b60ece94 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:33.276877 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8d0f0c67-8685-4b73-aa33-bbb0b60ece94 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:33.398334 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8d0f0c67-8685-4b73-aa33-bbb0b60ece94 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:33.405680 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8d0f0c67-8685-4b73-aa33-bbb0b60ece94 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.141347 Sep 24 03:39:33.406281 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 540/1085] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:33 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:33.647979 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-508320849", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1127999244", "security_groups": [{"name": "tempest-secgroup-smoke-1084952511"}], "block_device_mapping_v2": [{"uuid": "68dce92e-540d-4722-bbb7-8bec24b21097", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2db2bbde-716b-483e-ab4b-d8be258587c3"}]}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:39:33.753864 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.network.neutron [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] validate_networks() for [('2db2bbde-716b-483e-ab4b-d8be258587c3', None, None, None, None, None)] {{(pid=109374) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:39:34.147258 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Flavor limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:39:34.147258 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Image limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:39:34.147258 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Flavor pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:39:34.147620 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Image pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:39:34.147813 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:39:34.157357 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:34.157899 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:34.158702 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:34.159245 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:34.177151 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Getting quotas for project 6dfe51f1a692492e80a0c7c5a9078e73. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:39:34.181185 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Getting quotas for user 9ee5b6094e3b48739df3c797dfcc4edc and project 6dfe51f1a692492e80a0c7c5a9078e73. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:39:34.246336 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Going to run 1 instances... {{(pid=109374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:39:34.248849 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68dce92e-540d-4722-bbb7-8bec24b21097',volume_size=None,volume_type=None)] {{(pid=109374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:39:34.379671 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-52212145-ec8b-433e-8c81-b8b08616638d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.735293 Sep 24 03:39:34.380441 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 546/1086] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:39:33 2021] POST /compute/v2.1/servers => generated 406 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:39:34.390291 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a55bf0b4-4d51-47ef-ae9d-7383756a1655 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:34.390937 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a55bf0b4-4d51-47ef-ae9d-7383756a1655 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:34.426624 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b111934f-435f-4b0c-b9ed-cf6d3f829f40 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:34.427276 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b111934f-435f-4b0c-b9ed-cf6d3f829f40 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:34.433872 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b111934f-435f-4b0c-b9ed-cf6d3f829f40 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:34.434485 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b111934f-435f-4b0c-b9ed-cf6d3f829f40 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:34.435274 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b111934f-435f-4b0c-b9ed-cf6d3f829f40 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:34.435714 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b111934f-435f-4b0c-b9ed-cf6d3f829f40 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:34.447844 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a55bf0b4-4d51-47ef-ae9d-7383756a1655 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:34.458237 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a55bf0b4-4d51-47ef-ae9d-7383756a1655 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1094 microversion: 2.1 time: 0.069152 Sep 24 03:39:34.460217 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 541/1087] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:34 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:39:34.575902 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b111934f-435f-4b0c-b9ed-cf6d3f829f40 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:34.586663 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b111934f-435f-4b0c-b9ed-cf6d3f829f40 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1569 microversion: 2.1 time: 0.167658 Sep 24 03:39:34.587277 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 547/1088] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:34 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:39:34.604360 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-948d6bfe-3d5d-4410-8cea-2acbe0a3ed12 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:39:34.605395 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-948d6bfe-3d5d-4410-8cea-2acbe0a3ed12 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:34.613265 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-948d6bfe-3d5d-4410-8cea-2acbe0a3ed12 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:34.613906 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-948d6bfe-3d5d-4410-8cea-2acbe0a3ed12 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:34.614813 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-948d6bfe-3d5d-4410-8cea-2acbe0a3ed12 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:34.615295 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-948d6bfe-3d5d-4410-8cea-2acbe0a3ed12 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:34.695688 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-948d6bfe-3d5d-4410-8cea-2acbe0a3ed12 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "POST /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3/action" status: 202 len: 0 microversion: 2.1 time: 0.095200 Sep 24 03:39:34.696443 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 542/1089] 10.222.0.18 () {60 vars in 1278 bytes} [Fri Sep 24 03:39:34 2021] POST /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 03:39:34.705347 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-22d66571-537c-4e8f-a3bd-a32e7c24600b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:34.706098 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-22d66571-537c-4e8f-a3bd-a32e7c24600b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:34.712252 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-22d66571-537c-4e8f-a3bd-a32e7c24600b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:34.712803 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-22d66571-537c-4e8f-a3bd-a32e7c24600b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:34.713653 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-22d66571-537c-4e8f-a3bd-a32e7c24600b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:34.714304 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-22d66571-537c-4e8f-a3bd-a32e7c24600b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:34.848483 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-22d66571-537c-4e8f-a3bd-a32e7c24600b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:34.856178 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-22d66571-537c-4e8f-a3bd-a32e7c24600b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1517 microversion: 2.1 time: 0.154602 Sep 24 03:39:34.856843 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 548/1090] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:34 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:35.477376 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-4e9df332-0408-4e77-93f1-ca5fc1d5976f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:35.477790 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-4e9df332-0408-4e77-93f1-ca5fc1d5976f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:35.487358 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4e9df332-0408-4e77-93f1-ca5fc1d5976f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:35.488064 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4e9df332-0408-4e77-93f1-ca5fc1d5976f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:35.488984 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4e9df332-0408-4e77-93f1-ca5fc1d5976f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:35.489270 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4e9df332-0408-4e77-93f1-ca5fc1d5976f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:35.582895 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4e9df332-0408-4e77-93f1-ca5fc1d5976f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:35.590463 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-4e9df332-0408-4e77-93f1-ca5fc1d5976f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1210 microversion: 2.1 time: 0.118608 Sep 24 03:39:35.591142 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 543/1091] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:35 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1210 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:35.874765 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8e66e240-2ede-4217-9515-8703056b97fa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:35.876022 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8e66e240-2ede-4217-9515-8703056b97fa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:35.882509 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8e66e240-2ede-4217-9515-8703056b97fa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:35.882958 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8e66e240-2ede-4217-9515-8703056b97fa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:35.884103 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8e66e240-2ede-4217-9515-8703056b97fa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:35.884644 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8e66e240-2ede-4217-9515-8703056b97fa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:36.118234 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8e66e240-2ede-4217-9515-8703056b97fa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:36.126802 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8e66e240-2ede-4217-9515-8703056b97fa tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1517 microversion: 2.1 time: 0.255605 Sep 24 03:39:36.134703 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 549/1092] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:35 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1517 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:36.559425 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-c1b49955-9c18-4478-8c8c-847b04e80aa9 req-7b4aadaa-4244-4c35-9dd0-db2f560f7ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a23918f-1f46-46ff-8559-df4e0d82e8d3", "name": "network-vif-unplugged", "status": "completed", "tag": "0dfff50d-916c-4ef8-b736-5fe358a4016f"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:39:36.564554 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:39:36.564554 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:39:36.584508 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-c1b49955-9c18-4478-8c8c-847b04e80aa9 req-7b4aadaa-4244-4c35-9dd0-db2f560f7ae4 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:36.584993 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-c1b49955-9c18-4478-8c8c-847b04e80aa9 req-7b4aadaa-4244-4c35-9dd0-db2f560f7ae4 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:36.608687 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0f8623b6-e931-4aeb-bde5-4d77452922b1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:36.609427 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0f8623b6-e931-4aeb-bde5-4d77452922b1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:36.613662 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.compute.server_external_events [req-c1b49955-9c18-4478-8c8c-847b04e80aa9 req-7b4aadaa-4244-4c35-9dd0-db2f560f7ae4 service nova] Unable to find a host for instance 8a23918f-1f46-46ff-8559-df4e0d82e8d3. Dropping event network-vif-unplugged {{(pid=109375) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 24 03:39:36.615162 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-c1b49955-9c18-4478-8c8c-847b04e80aa9 req-7b4aadaa-4244-4c35-9dd0-db2f560f7ae4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.068623 Sep 24 03:39:36.616522 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 544/1093] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:39:36 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 71 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 24 03:39:36.618064 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0f8623b6-e931-4aeb-bde5-4d77452922b1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:36.619283 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0f8623b6-e931-4aeb-bde5-4d77452922b1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:36.623378 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0f8623b6-e931-4aeb-bde5-4d77452922b1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:36.623916 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0f8623b6-e931-4aeb-bde5-4d77452922b1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:36.841228 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0f8623b6-e931-4aeb-bde5-4d77452922b1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:36.848822 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0f8623b6-e931-4aeb-bde5-4d77452922b1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1266 microversion: 2.1 time: 0.244521 Sep 24 03:39:36.849456 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 550/1094] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:36 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:36.925657 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-d2214bdb-6daf-4570-996c-4d3ff06dfe5a req-5d66d541-6bef-4ea5-a8b2-6b1e23594e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4965e258-30ca-4b70-ab5a-9f78a973c53d", "tag": "2ae6434c-5d7c-4b7f-bce5-a52db126ebb3"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:39:36.927163 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:39:36.927163 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:39:36.941307 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-d2214bdb-6daf-4570-996c-4d3ff06dfe5a req-5d66d541-6bef-4ea5-a8b2-6b1e23594e1a service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:36.942083 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-d2214bdb-6daf-4570-996c-4d3ff06dfe5a req-5d66d541-6bef-4ea5-a8b2-6b1e23594e1a service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:36.962053 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-d2214bdb-6daf-4570-996c-4d3ff06dfe5a req-5d66d541-6bef-4ea5-a8b2-6b1e23594e1a service nova] Creating event network-changed:2ae6434c-5d7c-4b7f-bce5-a52db126ebb3 for instance 4965e258-30ca-4b70-ab5a-9f78a973c53d on hv-cinder-81080 Sep 24 03:39:36.968702 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-d2214bdb-6daf-4570-996c-4d3ff06dfe5a req-5d66d541-6bef-4ea5-a8b2-6b1e23594e1a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048023 Sep 24 03:39:36.970709 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 545/1095] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:39:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:39:37.150931 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7842af43-d785-48d0-ba2a-f711fd0aa36e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:37.154476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-7842af43-d785-48d0-ba2a-f711fd0aa36e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:37.161560 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7842af43-d785-48d0-ba2a-f711fd0aa36e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:37.162071 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7842af43-d785-48d0-ba2a-f711fd0aa36e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:37.164060 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7842af43-d785-48d0-ba2a-f711fd0aa36e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:37.165257 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7842af43-d785-48d0-ba2a-f711fd0aa36e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:37.380137 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7842af43-d785-48d0-ba2a-f711fd0aa36e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:37.387464 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7842af43-d785-48d0-ba2a-f711fd0aa36e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1517 microversion: 2.1 time: 0.241947 Sep 24 03:39:37.388033 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 551/1096] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:37 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:37.866560 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-6ac0deab-592c-4bb2-ba2f-9265ed15e088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:37.867329 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-6ac0deab-592c-4bb2-ba2f-9265ed15e088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:37.873585 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6ac0deab-592c-4bb2-ba2f-9265ed15e088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:37.874134 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6ac0deab-592c-4bb2-ba2f-9265ed15e088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:37.876134 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6ac0deab-592c-4bb2-ba2f-9265ed15e088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:37.876627 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-6ac0deab-592c-4bb2-ba2f-9265ed15e088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:38.019225 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-6ac0deab-592c-4bb2-ba2f-9265ed15e088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:38.026670 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-6ac0deab-592c-4bb2-ba2f-9265ed15e088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1266 microversion: 2.1 time: 0.164274 Sep 24 03:39:38.027227 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 546/1097] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:37 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:38.404800 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-34814bad-ae15-45b7-a217-39cf3f2d4de2 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:38.405434 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-34814bad-ae15-45b7-a217-39cf3f2d4de2 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:38.411754 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34814bad-ae15-45b7-a217-39cf3f2d4de2 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:38.412195 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34814bad-ae15-45b7-a217-39cf3f2d4de2 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:38.412955 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34814bad-ae15-45b7-a217-39cf3f2d4de2 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:38.413382 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-34814bad-ae15-45b7-a217-39cf3f2d4de2 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:38.541882 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-34814bad-ae15-45b7-a217-39cf3f2d4de2 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:38.549791 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-34814bad-ae15-45b7-a217-39cf3f2d4de2 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1517 microversion: 2.1 time: 0.148660 Sep 24 03:39:38.550383 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 552/1098] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:38 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:39.043446 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-54986bd4-513c-48df-a7e6-1b8205831f36 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:39.044046 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-54986bd4-513c-48df-a7e6-1b8205831f36 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:39.050301 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-54986bd4-513c-48df-a7e6-1b8205831f36 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:39.050800 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-54986bd4-513c-48df-a7e6-1b8205831f36 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:39.051495 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-54986bd4-513c-48df-a7e6-1b8205831f36 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:39.051925 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-54986bd4-513c-48df-a7e6-1b8205831f36 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:39.169093 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-54986bd4-513c-48df-a7e6-1b8205831f36 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:39.176870 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-54986bd4-513c-48df-a7e6-1b8205831f36 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1266 microversion: 2.1 time: 0.137094 Sep 24 03:39:39.177436 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 547/1099] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:39 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:39.566949 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-944456c0-6927-442e-8ac3-d111dcbc7025 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:39.567555 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-944456c0-6927-442e-8ac3-d111dcbc7025 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:39.573403 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-944456c0-6927-442e-8ac3-d111dcbc7025 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:39.573887 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-944456c0-6927-442e-8ac3-d111dcbc7025 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:39.574647 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-944456c0-6927-442e-8ac3-d111dcbc7025 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:39.575074 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-944456c0-6927-442e-8ac3-d111dcbc7025 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:39.694682 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-944456c0-6927-442e-8ac3-d111dcbc7025 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:39.703787 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-944456c0-6927-442e-8ac3-d111dcbc7025 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1517 microversion: 2.1 time: 0.140465 Sep 24 03:39:39.704346 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 553/1100] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:39 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1517 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:39:40.193646 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-4de388bd-ab33-4591-8552-6fe01b3cf5ca tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:40.194209 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-4de388bd-ab33-4591-8552-6fe01b3cf5ca tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:40.200134 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4de388bd-ab33-4591-8552-6fe01b3cf5ca tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:40.200575 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4de388bd-ab33-4591-8552-6fe01b3cf5ca tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:40.201332 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4de388bd-ab33-4591-8552-6fe01b3cf5ca tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:40.201793 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4de388bd-ab33-4591-8552-6fe01b3cf5ca tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:40.320065 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4de388bd-ab33-4591-8552-6fe01b3cf5ca tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:40.327203 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-4de388bd-ab33-4591-8552-6fe01b3cf5ca tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1266 microversion: 2.1 time: 0.137293 Sep 24 03:39:40.327918 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 548/1101] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:40 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:40.720136 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b5346f3c-4be2-4bed-ae15-62c2ab651afc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:40.720738 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b5346f3c-4be2-4bed-ae15-62c2ab651afc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:40.726556 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b5346f3c-4be2-4bed-ae15-62c2ab651afc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:40.726995 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b5346f3c-4be2-4bed-ae15-62c2ab651afc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:40.727755 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b5346f3c-4be2-4bed-ae15-62c2ab651afc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:40.728180 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b5346f3c-4be2-4bed-ae15-62c2ab651afc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:40.848923 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b5346f3c-4be2-4bed-ae15-62c2ab651afc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:40.857752 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b5346f3c-4be2-4bed-ae15-62c2ab651afc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1517 microversion: 2.1 time: 0.141263 Sep 24 03:39:40.859096 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 554/1102] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:40 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1517 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:41.342766 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3e536378-b758-4363-9c7f-098f564d292d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:41.343935 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3e536378-b758-4363-9c7f-098f564d292d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:41.349647 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3e536378-b758-4363-9c7f-098f564d292d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:41.350116 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3e536378-b758-4363-9c7f-098f564d292d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:41.350865 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3e536378-b758-4363-9c7f-098f564d292d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:41.351388 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3e536378-b758-4363-9c7f-098f564d292d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:41.477146 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-3e536378-b758-4363-9c7f-098f564d292d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:41.485739 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3e536378-b758-4363-9c7f-098f564d292d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1266 microversion: 2.1 time: 0.146566 Sep 24 03:39:41.486328 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 549/1103] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:41 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:41.875676 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5f7609ab-dc7e-478a-8372-2c029aad2f99 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:41.876275 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5f7609ab-dc7e-478a-8372-2c029aad2f99 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:41.882198 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f7609ab-dc7e-478a-8372-2c029aad2f99 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:41.882660 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f7609ab-dc7e-478a-8372-2c029aad2f99 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:41.883411 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f7609ab-dc7e-478a-8372-2c029aad2f99 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:41.883831 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5f7609ab-dc7e-478a-8372-2c029aad2f99 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:42.053132 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5f7609ab-dc7e-478a-8372-2c029aad2f99 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:42.060564 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5f7609ab-dc7e-478a-8372-2c029aad2f99 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1575 microversion: 2.1 time: 0.188626 Sep 24 03:39:42.061138 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 555/1104] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:41 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:42.504148 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-04c798ae-3120-41fa-b365-6458210d28e9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:42.504855 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-04c798ae-3120-41fa-b365-6458210d28e9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:42.511266 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-04c798ae-3120-41fa-b365-6458210d28e9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:42.511715 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-04c798ae-3120-41fa-b365-6458210d28e9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:42.512501 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-04c798ae-3120-41fa-b365-6458210d28e9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:42.512936 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-04c798ae-3120-41fa-b365-6458210d28e9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:42.720561 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-04c798ae-3120-41fa-b365-6458210d28e9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:42.727850 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-04c798ae-3120-41fa-b365-6458210d28e9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1266 microversion: 2.1 time: 0.227630 Sep 24 03:39:42.728420 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 550/1105] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:42 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:43.079419 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6a6709af-6a0f-4f16-8b02-b758329d9b18 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:43.080027 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6a6709af-6a0f-4f16-8b02-b758329d9b18 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:43.085904 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6a6709af-6a0f-4f16-8b02-b758329d9b18 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:43.086355 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6a6709af-6a0f-4f16-8b02-b758329d9b18 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:43.087110 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6a6709af-6a0f-4f16-8b02-b758329d9b18 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:43.087536 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6a6709af-6a0f-4f16-8b02-b758329d9b18 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:43.206185 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6a6709af-6a0f-4f16-8b02-b758329d9b18 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:43.213402 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6a6709af-6a0f-4f16-8b02-b758329d9b18 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1575 microversion: 2.1 time: 0.138811 Sep 24 03:39:43.213999 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 556/1106] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:43 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1575 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:43.744049 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-f0d613c0-eda6-4998-a9da-56b8130ca370 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:43.744660 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-f0d613c0-eda6-4998-a9da-56b8130ca370 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:43.751543 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f0d613c0-eda6-4998-a9da-56b8130ca370 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:43.751956 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f0d613c0-eda6-4998-a9da-56b8130ca370 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:43.752893 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f0d613c0-eda6-4998-a9da-56b8130ca370 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:43.753398 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-f0d613c0-eda6-4998-a9da-56b8130ca370 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:43.880268 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-f0d613c0-eda6-4998-a9da-56b8130ca370 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:43.888213 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-f0d613c0-eda6-4998-a9da-56b8130ca370 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1266 microversion: 2.1 time: 0.147861 Sep 24 03:39:43.888798 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 551/1107] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:43 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:44.231316 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-dd403855-fd47-4731-acdf-f412c802272e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:44.232128 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-dd403855-fd47-4731-acdf-f412c802272e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:44.238389 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dd403855-fd47-4731-acdf-f412c802272e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:44.238826 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dd403855-fd47-4731-acdf-f412c802272e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:44.239576 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dd403855-fd47-4731-acdf-f412c802272e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:44.239995 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-dd403855-fd47-4731-acdf-f412c802272e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:44.360393 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-dd403855-fd47-4731-acdf-f412c802272e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:44.367742 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-dd403855-fd47-4731-acdf-f412c802272e tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1575 microversion: 2.1 time: 0.140062 Sep 24 03:39:44.368310 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 557/1108] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:44 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1575 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:44.906275 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-784d525c-6f81-485f-936d-da79f567abc8 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:44.906275 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-784d525c-6f81-485f-936d-da79f567abc8 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:44.912991 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-784d525c-6f81-485f-936d-da79f567abc8 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:44.913730 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-784d525c-6f81-485f-936d-da79f567abc8 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:44.915370 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-784d525c-6f81-485f-936d-da79f567abc8 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:44.915801 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-784d525c-6f81-485f-936d-da79f567abc8 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:45.048114 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-784d525c-6f81-485f-936d-da79f567abc8 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:45.055563 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-784d525c-6f81-485f-936d-da79f567abc8 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1266 microversion: 2.1 time: 0.154236 Sep 24 03:39:45.056457 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 552/1109] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:44 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:45.384614 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-224dfc12-3700-4342-a0ac-8fbcb5daef08 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:45.385219 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-224dfc12-3700-4342-a0ac-8fbcb5daef08 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:45.391718 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-224dfc12-3700-4342-a0ac-8fbcb5daef08 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:45.392159 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-224dfc12-3700-4342-a0ac-8fbcb5daef08 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:45.392922 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-224dfc12-3700-4342-a0ac-8fbcb5daef08 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:45.393348 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-224dfc12-3700-4342-a0ac-8fbcb5daef08 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:45.513872 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-224dfc12-3700-4342-a0ac-8fbcb5daef08 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:45.522242 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-224dfc12-3700-4342-a0ac-8fbcb5daef08 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1575 microversion: 2.1 time: 0.141187 Sep 24 03:39:45.522810 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 558/1110] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:45 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1575 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:46.072818 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-eed6f417-be50-47aa-b121-91762d1d761e tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:46.073454 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-eed6f417-be50-47aa-b121-91762d1d761e tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:46.080176 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-eed6f417-be50-47aa-b121-91762d1d761e tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:46.080625 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-eed6f417-be50-47aa-b121-91762d1d761e tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:46.081403 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-eed6f417-be50-47aa-b121-91762d1d761e tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:46.081868 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-eed6f417-be50-47aa-b121-91762d1d761e tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:46.272535 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-eed6f417-be50-47aa-b121-91762d1d761e tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:46.279814 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-eed6f417-be50-47aa-b121-91762d1d761e tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1266 microversion: 2.1 time: 0.210864 Sep 24 03:39:46.280388 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 553/1111] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:46 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:46.540911 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-30cfc3b5-a5eb-47be-aa56-fb2a30f23c6b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:46.541536 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-30cfc3b5-a5eb-47be-aa56-fb2a30f23c6b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:46.548014 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30cfc3b5-a5eb-47be-aa56-fb2a30f23c6b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:46.548454 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30cfc3b5-a5eb-47be-aa56-fb2a30f23c6b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:46.549242 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30cfc3b5-a5eb-47be-aa56-fb2a30f23c6b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:46.549661 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-30cfc3b5-a5eb-47be-aa56-fb2a30f23c6b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:46.659287 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-5627401e-2c80-4869-abfb-4c5d708dd275 req-e51067aa-83bf-4c9d-acee-35d19a6cd248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4965e258-30ca-4b70-ab5a-9f78a973c53d", "name": "network-vif-plugged", "status": "completed", "tag": "2ae6434c-5d7c-4b7f-bce5-a52db126ebb3"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:39:46.660795 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:39:46.660795 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:39:46.669008 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-5627401e-2c80-4869-abfb-4c5d708dd275 req-e51067aa-83bf-4c9d-acee-35d19a6cd248 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:46.669700 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-5627401e-2c80-4869-abfb-4c5d708dd275 req-e51067aa-83bf-4c9d-acee-35d19a6cd248 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:46.681795 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-5627401e-2c80-4869-abfb-4c5d708dd275 req-e51067aa-83bf-4c9d-acee-35d19a6cd248 service nova] Creating event network-vif-plugged:2ae6434c-5d7c-4b7f-bce5-a52db126ebb3 for instance 4965e258-30ca-4b70-ab5a-9f78a973c53d on hv-cinder-81080 Sep 24 03:39:46.689368 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-5627401e-2c80-4869-abfb-4c5d708dd275 req-e51067aa-83bf-4c9d-acee-35d19a6cd248 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033881 Sep 24 03:39:46.690417 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 554/1112] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:39:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:39:46.716870 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-30cfc3b5-a5eb-47be-aa56-fb2a30f23c6b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:46.725255 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-30cfc3b5-a5eb-47be-aa56-fb2a30f23c6b tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1575 microversion: 2.1 time: 0.188730 Sep 24 03:39:46.726174 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 559/1113] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:46 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:47.297124 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d2baa636-e548-4bb5-9b6c-179162dd0c48 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:47.298056 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d2baa636-e548-4bb5-9b6c-179162dd0c48 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:47.304033 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d2baa636-e548-4bb5-9b6c-179162dd0c48 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:47.304476 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d2baa636-e548-4bb5-9b6c-179162dd0c48 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:47.305288 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d2baa636-e548-4bb5-9b6c-179162dd0c48 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:47.305700 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d2baa636-e548-4bb5-9b6c-179162dd0c48 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:47.429486 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d2baa636-e548-4bb5-9b6c-179162dd0c48 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:47.436959 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d2baa636-e548-4bb5-9b6c-179162dd0c48 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1266 microversion: 2.1 time: 0.144487 Sep 24 03:39:47.437789 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 555/1114] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:47 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:47.743626 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3cb5dd6b-6e0e-43f2-83b4-7b918bc00189 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:47.744333 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3cb5dd6b-6e0e-43f2-83b4-7b918bc00189 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:47.750130 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3cb5dd6b-6e0e-43f2-83b4-7b918bc00189 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:47.750571 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3cb5dd6b-6e0e-43f2-83b4-7b918bc00189 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:47.751331 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3cb5dd6b-6e0e-43f2-83b4-7b918bc00189 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:47.751750 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3cb5dd6b-6e0e-43f2-83b4-7b918bc00189 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:47.881705 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3cb5dd6b-6e0e-43f2-83b4-7b918bc00189 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:47.890744 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3cb5dd6b-6e0e-43f2-83b4-7b918bc00189 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1575 microversion: 2.1 time: 0.150650 Sep 24 03:39:47.900294 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 560/1115] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:47 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:48.454227 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-70078f5f-ae3c-4454-86a7-7cf9525d4a08 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:48.454956 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-70078f5f-ae3c-4454-86a7-7cf9525d4a08 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:48.460672 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-70078f5f-ae3c-4454-86a7-7cf9525d4a08 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:48.461016 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-70078f5f-ae3c-4454-86a7-7cf9525d4a08 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:48.466311 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-70078f5f-ae3c-4454-86a7-7cf9525d4a08 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:48.466311 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-70078f5f-ae3c-4454-86a7-7cf9525d4a08 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:48.590503 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-70078f5f-ae3c-4454-86a7-7cf9525d4a08 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:48.599514 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-70078f5f-ae3c-4454-86a7-7cf9525d4a08 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1453 microversion: 2.1 time: 0.150038 Sep 24 03:39:48.600089 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 556/1116] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:48 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:48.615389 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-b4c9ada0-f6f2-40dc-8033-b32e6512ac7c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:48.615993 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-b4c9ada0-f6f2-40dc-8033-b32e6512ac7c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:48.621792 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b4c9ada0-f6f2-40dc-8033-b32e6512ac7c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:48.622238 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b4c9ada0-f6f2-40dc-8033-b32e6512ac7c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:48.623001 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b4c9ada0-f6f2-40dc-8033-b32e6512ac7c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:48.623435 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-b4c9ada0-f6f2-40dc-8033-b32e6512ac7c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:48.753761 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-b4c9ada0-f6f2-40dc-8033-b32e6512ac7c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:48.761094 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-b4c9ada0-f6f2-40dc-8033-b32e6512ac7c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1453 microversion: 2.1 time: 0.149257 Sep 24 03:39:48.761664 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 561/1117] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:48 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:48.911334 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-e6b0aeda-e544-4e2d-9593-65bd6025accf tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:48.911979 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-e6b0aeda-e544-4e2d-9593-65bd6025accf tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:48.921400 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e6b0aeda-e544-4e2d-9593-65bd6025accf tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:48.922457 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e6b0aeda-e544-4e2d-9593-65bd6025accf tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:48.923532 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e6b0aeda-e544-4e2d-9593-65bd6025accf tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:48.924031 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-e6b0aeda-e544-4e2d-9593-65bd6025accf tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:49.106795 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-e6b0aeda-e544-4e2d-9593-65bd6025accf tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:49.114967 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-e6b0aeda-e544-4e2d-9593-65bd6025accf tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1575 microversion: 2.1 time: 0.210185 Sep 24 03:39:49.115644 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 557/1118] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:48 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:50.132364 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-1345fa44-36e8-466f-8bc5-d25dd5bba26a tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:50.132980 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-1345fa44-36e8-466f-8bc5-d25dd5bba26a tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:50.138859 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1345fa44-36e8-466f-8bc5-d25dd5bba26a tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:50.139307 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1345fa44-36e8-466f-8bc5-d25dd5bba26a tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:50.140160 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1345fa44-36e8-466f-8bc5-d25dd5bba26a tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:50.140589 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-1345fa44-36e8-466f-8bc5-d25dd5bba26a tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:50.417404 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-1345fa44-36e8-466f-8bc5-d25dd5bba26a tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:50.430100 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-1345fa44-36e8-466f-8bc5-d25dd5bba26a tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1575 microversion: 2.1 time: 0.301346 Sep 24 03:39:50.430710 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 562/1119] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:50 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1575 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:50.846094 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-da4aafe0-d649-4644-b20a-8bc96ef937dc req-f84993f8-cb6d-4313-9891-b250f6b1a012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4965e258-30ca-4b70-ab5a-9f78a973c53d", "tag": "2ae6434c-5d7c-4b7f-bce5-a52db126ebb3"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:39:50.848500 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:39:50.848500 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:39:50.855654 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-da4aafe0-d649-4644-b20a-8bc96ef937dc req-f84993f8-cb6d-4313-9891-b250f6b1a012 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:50.856095 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-da4aafe0-d649-4644-b20a-8bc96ef937dc req-f84993f8-cb6d-4313-9891-b250f6b1a012 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:50.869850 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-da4aafe0-d649-4644-b20a-8bc96ef937dc req-f84993f8-cb6d-4313-9891-b250f6b1a012 service nova] Creating event network-changed:2ae6434c-5d7c-4b7f-bce5-a52db126ebb3 for instance 4965e258-30ca-4b70-ab5a-9f78a973c53d on hv-cinder-81080 Sep 24 03:39:50.875316 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-da4aafe0-d649-4644-b20a-8bc96ef937dc req-f84993f8-cb6d-4313-9891-b250f6b1a012 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033483 Sep 24 03:39:50.876245 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 558/1120] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:39:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:39:51.447186 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c98df963-8f9a-405f-bb65-b61c42049390 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:51.448768 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c98df963-8f9a-405f-bb65-b61c42049390 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:51.459207 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c98df963-8f9a-405f-bb65-b61c42049390 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:51.459652 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c98df963-8f9a-405f-bb65-b61c42049390 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:51.460590 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c98df963-8f9a-405f-bb65-b61c42049390 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:51.461021 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c98df963-8f9a-405f-bb65-b61c42049390 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:51.674795 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c98df963-8f9a-405f-bb65-b61c42049390 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:51.682806 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c98df963-8f9a-405f-bb65-b61c42049390 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1575 microversion: 2.1 time: 0.239300 Sep 24 03:39:51.683610 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 563/1121] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:51 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:52.692257 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-d01869f2-a8ea-42a1-9c5b-b513b6a757b0 req-5db348f0-cf3e-4c9f-aa08-fd3891d43607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a23918f-1f46-46ff-8559-df4e0d82e8d3", "name": "network-vif-plugged", "status": "completed", "tag": "0dfff50d-916c-4ef8-b736-5fe358a4016f"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:39:52.693918 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:39:52.693918 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:39:52.701314 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-6c41a150-25e2-44ec-8a3c-1dac6eb34df7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:52.702655 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-6c41a150-25e2-44ec-8a3c-1dac6eb34df7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:52.712995 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6c41a150-25e2-44ec-8a3c-1dac6eb34df7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:52.713591 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6c41a150-25e2-44ec-8a3c-1dac6eb34df7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:52.715955 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-d01869f2-a8ea-42a1-9c5b-b513b6a757b0 req-5db348f0-cf3e-4c9f-aa08-fd3891d43607 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:52.716890 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6c41a150-25e2-44ec-8a3c-1dac6eb34df7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:52.717413 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-6c41a150-25e2-44ec-8a3c-1dac6eb34df7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:52.721557 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-d01869f2-a8ea-42a1-9c5b-b513b6a757b0 req-5db348f0-cf3e-4c9f-aa08-fd3891d43607 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:52.742512 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-d01869f2-a8ea-42a1-9c5b-b513b6a757b0 req-5db348f0-cf3e-4c9f-aa08-fd3891d43607 service nova] Creating event network-vif-plugged:0dfff50d-916c-4ef8-b736-5fe358a4016f for instance 8a23918f-1f46-46ff-8559-df4e0d82e8d3 on hv-cinder-81080 Sep 24 03:39:52.751009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-d01869f2-a8ea-42a1-9c5b-b513b6a757b0 req-5db348f0-cf3e-4c9f-aa08-fd3891d43607 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063175 Sep 24 03:39:52.751798 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 559/1122] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:39:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:39:52.868538 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-6c41a150-25e2-44ec-8a3c-1dac6eb34df7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:52.879758 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-6c41a150-25e2-44ec-8a3c-1dac6eb34df7 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1575 microversion: 2.1 time: 0.181635 Sep 24 03:39:52.880340 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 564/1123] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:52 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:53.897878 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-a967db47-8782-4bd6-b210-b892add89e46 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:53.898578 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-a967db47-8782-4bd6-b210-b892add89e46 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:53.905089 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a967db47-8782-4bd6-b210-b892add89e46 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:53.905763 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a967db47-8782-4bd6-b210-b892add89e46 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:53.907339 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a967db47-8782-4bd6-b210-b892add89e46 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:53.907778 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-a967db47-8782-4bd6-b210-b892add89e46 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:54.056703 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-a967db47-8782-4bd6-b210-b892add89e46 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:54.064467 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-a967db47-8782-4bd6-b210-b892add89e46 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1575 microversion: 2.1 time: 0.170559 Sep 24 03:39:54.065533 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 560/1124] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:53 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:39:55.081540 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-3c0edc46-7eff-4862-8bf2-100f391b9237 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:39:55.082731 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-3c0edc46-7eff-4862-8bf2-100f391b9237 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:39:55.089330 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3c0edc46-7eff-4862-8bf2-100f391b9237 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:55.090050 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3c0edc46-7eff-4862-8bf2-100f391b9237 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:55.091758 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3c0edc46-7eff-4862-8bf2-100f391b9237 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:39:55.092347 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-3c0edc46-7eff-4862-8bf2-100f391b9237 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:39:55.237807 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-3c0edc46-7eff-4862-8bf2-100f391b9237 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:39:55.245728 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-3c0edc46-7eff-4862-8bf2-100f391b9237 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1562 microversion: 2.1 time: 0.167987 Sep 24 03:39:55.246512 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 565/1125] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:39:55 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:41:15.819040 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9b7c824-2b2f-40a5-baaf-117cd6cabeb5] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 03:41:15.822757 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d0ae38e3-0bcf-43b5-b61c-61f01ad945d4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:15.823271 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d0ae38e3-0bcf-43b5-b61c-61f01ad945d4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:15.828078 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7dea567a-02b1-46aa-bbf7-7f07f1010afa] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 03:41:15.829696 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d0ae38e3-0bcf-43b5-b61c-61f01ad945d4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:15.830235 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d0ae38e3-0bcf-43b5-b61c-61f01ad945d4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:15.831208 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d0ae38e3-0bcf-43b5-b61c-61f01ad945d4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:15.831463 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-ac7a2100-fdb9-4e30-90f8-22d5ed3903cd req-0ce1366d-9528-401e-826a-92d9ef9512cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a23918f-1f46-46ff-8559-df4e0d82e8d3", "tag": "0dfff50d-916c-4ef8-b736-5fe358a4016f"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:41:15.832055 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d0ae38e3-0bcf-43b5-b61c-61f01ad945d4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:15.833005 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:41:15.833005 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:41:15.840662 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-ac7a2100-fdb9-4e30-90f8-22d5ed3903cd req-0ce1366d-9528-401e-826a-92d9ef9512cd service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:15.841300 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-ac7a2100-fdb9-4e30-90f8-22d5ed3903cd req-0ce1366d-9528-401e-826a-92d9ef9512cd service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:15.853024 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-ac7a2100-fdb9-4e30-90f8-22d5ed3903cd req-0ce1366d-9528-401e-826a-92d9ef9512cd service nova] Creating event network-changed:0dfff50d-916c-4ef8-b736-5fe358a4016f for instance 8a23918f-1f46-46ff-8559-df4e0d82e8d3 on hv-cinder-81080 Sep 24 03:41:15.858968 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-ac7a2100-fdb9-4e30-90f8-22d5ed3903cd req-0ce1366d-9528-401e-826a-92d9ef9512cd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032763 Sep 24 03:41:15.859838 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d0ae38e3-0bcf-43b5-b61c-61f01ad945d4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Going to try to terminate instance {{(pid=109375) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:41:15.859980 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 566/1126] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:41:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:41:15.948307 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d0ae38e3-0bcf-43b5-b61c-61f01ad945d4 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 204 len: 0 microversion: 2.1 time: 0.131495 Sep 24 03:41:15.948868 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 561/1127] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:41:15 2021] DELETE /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:41:15.957285 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8ab7042e-6c54-4b9a-94c6-64c6fc3829fe tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:15.958273 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8ab7042e-6c54-4b9a-94c6-64c6fc3829fe tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:15.966342 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8ab7042e-6c54-4b9a-94c6-64c6fc3829fe tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:15.966920 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8ab7042e-6c54-4b9a-94c6-64c6fc3829fe tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:15.967941 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8ab7042e-6c54-4b9a-94c6-64c6fc3829fe tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:15.968567 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8ab7042e-6c54-4b9a-94c6-64c6fc3829fe tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:16.174465 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8ab7042e-6c54-4b9a-94c6-64c6fc3829fe tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:41:16.182516 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8ab7042e-6c54-4b9a-94c6-64c6fc3829fe tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1568 microversion: 2.1 time: 0.229136 Sep 24 03:41:16.183364 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 567/1128] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:41:15 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:41:17.200694 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-44c81ae2-3f76-43ac-a159-fa410d3b9aae tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:17.201552 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-44c81ae2-3f76-43ac-a159-fa410d3b9aae tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:17.218272 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-44c81ae2-3f76-43ac-a159-fa410d3b9aae tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:17.218715 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-44c81ae2-3f76-43ac-a159-fa410d3b9aae tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:17.219489 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-44c81ae2-3f76-43ac-a159-fa410d3b9aae tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:17.219917 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-44c81ae2-3f76-43ac-a159-fa410d3b9aae tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:17.236023 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9b7c824-2b2f-40a5-baaf-117cd6cabeb5] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 54438. Sep 24 03:41:17.342500 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-44c81ae2-3f76-43ac-a159-fa410d3b9aae tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:41:17.350411 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-44c81ae2-3f76-43ac-a159-fa410d3b9aae tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1450 microversion: 2.1 time: 0.153806 Sep 24 03:41:17.350983 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 562/1129] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:41:17 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:41:18.144054 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-2049f895-b6e2-4407-8882-7181c2c11772 req-3e5ae3ca-99dd-46e7-b519-f97341844dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a23918f-1f46-46ff-8559-df4e0d82e8d3", "name": "network-vif-deleted", "tag": "0dfff50d-916c-4ef8-b736-5fe358a4016f"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:41:18.145656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:41:18.145656 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:41:18.167345 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-2049f895-b6e2-4407-8882-7181c2c11772 req-3e5ae3ca-99dd-46e7-b519-f97341844dbf service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:18.167699 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-2049f895-b6e2-4407-8882-7181c2c11772 req-3e5ae3ca-99dd-46e7-b519-f97341844dbf service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:18.178475 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO oslo.messaging._drivers.impl_rabbit [-] [7dea567a-02b1-46aa-bbf7-7f07f1010afa] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 54444. Sep 24 03:41:18.180333 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-2049f895-b6e2-4407-8882-7181c2c11772 req-3e5ae3ca-99dd-46e7-b519-f97341844dbf service nova] Creating event network-vif-deleted:0dfff50d-916c-4ef8-b736-5fe358a4016f for instance 8a23918f-1f46-46ff-8559-df4e0d82e8d3 on hv-cinder-81080 Sep 24 03:41:18.185017 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-2049f895-b6e2-4407-8882-7181c2c11772 req-3e5ae3ca-99dd-46e7-b519-f97341844dbf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044554 Sep 24 03:41:18.185429 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 568/1130] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:41:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:41:18.368473 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-70e8be1d-b9e7-4e02-9c9c-d4f9fa0dcb74 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:18.369097 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-70e8be1d-b9e7-4e02-9c9c-d4f9fa0dcb74 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:18.375100 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-70e8be1d-b9e7-4e02-9c9c-d4f9fa0dcb74 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:18.375602 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-70e8be1d-b9e7-4e02-9c9c-d4f9fa0dcb74 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:18.376398 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-70e8be1d-b9e7-4e02-9c9c-d4f9fa0dcb74 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:18.376787 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-70e8be1d-b9e7-4e02-9c9c-d4f9fa0dcb74 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:18.583426 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-70e8be1d-b9e7-4e02-9c9c-d4f9fa0dcb74 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b84611e0b0496d9d5f6d24d180b567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c1af3d8fb24a3ea2c05a5b9d852f84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:41:18.591504 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-70e8be1d-b9e7-4e02-9c9c-d4f9fa0dcb74 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 200 len: 1219 microversion: 2.1 time: 0.227496 Sep 24 03:41:18.592077 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 563/1131] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:41:18 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 1219 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:41:19.609961 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-04bd689e-da80-437f-81e7-2ecf0eba2bdc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:19.610557 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-04bd689e-da80-437f-81e7-2ecf0eba2bdc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] [instance: 8a23918f-1f46-46ff-8559-df4e0d82e8d3] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:19.617569 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-04bd689e-da80-437f-81e7-2ecf0eba2bdc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:19.618032 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-04bd689e-da80-437f-81e7-2ecf0eba2bdc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:19.618790 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-04bd689e-da80-437f-81e7-2ecf0eba2bdc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:19.619213 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-04bd689e-da80-437f-81e7-2ecf0eba2bdc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:19.632389 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-04bd689e-da80-437f-81e7-2ecf0eba2bdc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] HTTP exception thrown: Instance 8a23918f-1f46-46ff-8559-df4e0d82e8d3 could not be found. Sep 24 03:41:19.632962 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-04bd689e-da80-437f-81e7-2ecf0eba2bdc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Returning 404 to user: Instance 8a23918f-1f46-46ff-8559-df4e0d82e8d3 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:41:19.633794 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-04bd689e-da80-437f-81e7-2ecf0eba2bdc tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3" status: 404 len: 111 microversion: 2.1 time: 0.028216 Sep 24 03:41:19.634327 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 569/1132] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:41:19 2021] GET /compute/v2.1/servers/8a23918f-1f46-46ff-8559-df4e0d82e8d3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:41:19.789663 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-18b7df56-5c69-49f1-b7c4-8b29a17796c1 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] Calling method '.version_select at 0x7f6664169af0>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:19.808913 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-18b7df56-5c69-49f1-b7c4-8b29a17796c1 tempest-TestShelveInstance-1175011633 tempest-TestShelveInstance-1175011633-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-786959083" status: 202 len: 0 microversion: 2.1 time: 0.023407 Sep 24 03:41:19.809769 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 564/1133] 10.222.0.18 () {58 vars in 1251 bytes} [Fri Sep 24 03:41:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-786959083 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:41:25.275938 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 03:41:25.276642 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: Fri Sep 24 03:41:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 24 03:41:45.573570 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 03:41:45.574316 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: Fri Sep 24 03:41:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 24 03:41:50.219888 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9d4685bb-5395-4304-b9c9-da2df4287a93 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:50.220494 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9d4685bb-5395-4304-b9c9-da2df4287a93 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:50.226777 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9d4685bb-5395-4304-b9c9-da2df4287a93 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:50.227222 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9d4685bb-5395-4304-b9c9-da2df4287a93 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:50.229144 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9d4685bb-5395-4304-b9c9-da2df4287a93 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:50.229581 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9d4685bb-5395-4304-b9c9-da2df4287a93 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:50.253953 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9d4685bb-5395-4304-b9c9-da2df4287a93 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Going to try to terminate instance {{(pid=109374) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:41:50.326022 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9d4685bb-5395-4304-b9c9-da2df4287a93 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 204 len: 0 microversion: 2.1 time: 0.109818 Sep 24 03:41:50.326704 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 570/1134] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:41:50 2021] DELETE /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:41:50.336057 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-3516cbd7-ec23-44ee-960e-e4e2f66edcaf tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:50.336665 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-3516cbd7-ec23-44ee-960e-e4e2f66edcaf tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:50.343445 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3516cbd7-ec23-44ee-960e-e4e2f66edcaf tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:50.343882 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3516cbd7-ec23-44ee-960e-e4e2f66edcaf tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:50.344638 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3516cbd7-ec23-44ee-960e-e4e2f66edcaf tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:50.345062 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-3516cbd7-ec23-44ee-960e-e4e2f66edcaf tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:50.464946 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-3516cbd7-ec23-44ee-960e-e4e2f66edcaf tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:41:50.472334 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-3516cbd7-ec23-44ee-960e-e4e2f66edcaf tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1578 microversion: 2.1 time: 0.141518 Sep 24 03:41:50.472977 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 565/1135] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:41:50 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1578 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:41:51.492280 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-c97ee085-4930-4747-b5c0-3b7611ff3c21 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:51.492989 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-c97ee085-4930-4747-b5c0-3b7611ff3c21 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:51.499353 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c97ee085-4930-4747-b5c0-3b7611ff3c21 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:51.499790 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c97ee085-4930-4747-b5c0-3b7611ff3c21 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:51.500535 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c97ee085-4930-4747-b5c0-3b7611ff3c21 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:51.500954 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-c97ee085-4930-4747-b5c0-3b7611ff3c21 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:51.812449 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-c97ee085-4930-4747-b5c0-3b7611ff3c21 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:41:51.819597 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-c97ee085-4930-4747-b5c0-3b7611ff3c21 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1578 microversion: 2.1 time: 0.331292 Sep 24 03:41:51.820161 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 571/1136] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:41:51 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1578 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:41:52.838015 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1e6966e9-ab9c-402b-a7be-79f376879a76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:52.839032 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1e6966e9-ab9c-402b-a7be-79f376879a76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:52.844931 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1e6966e9-ab9c-402b-a7be-79f376879a76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:52.845369 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1e6966e9-ab9c-402b-a7be-79f376879a76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:52.846167 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1e6966e9-ab9c-402b-a7be-79f376879a76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:52.846588 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1e6966e9-ab9c-402b-a7be-79f376879a76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:52.921978 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1e6966e9-ab9c-402b-a7be-79f376879a76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:41:52.931344 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1e6966e9-ab9c-402b-a7be-79f376879a76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 200 len: 1510 microversion: 2.1 time: 0.097423 Sep 24 03:41:52.931857 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 566/1137] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:41:52 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 1510 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:41:53.025828 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-54d48664-5cd4-4e34-abbb-856614d3fa85 req-26102906-e409-499b-b17b-b71d070b5a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4965e258-30ca-4b70-ab5a-9f78a973c53d", "name": "network-vif-deleted", "tag": "2ae6434c-5d7c-4b7f-bce5-a52db126ebb3"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:41:53.027729 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:41:53.027729 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:41:53.035585 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-54d48664-5cd4-4e34-abbb-856614d3fa85 req-26102906-e409-499b-b17b-b71d070b5a1c service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:53.036088 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-54d48664-5cd4-4e34-abbb-856614d3fa85 req-26102906-e409-499b-b17b-b71d070b5a1c service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:53.058505 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-54d48664-5cd4-4e34-abbb-856614d3fa85 req-26102906-e409-499b-b17b-b71d070b5a1c service nova] Creating event network-vif-deleted:2ae6434c-5d7c-4b7f-bce5-a52db126ebb3 for instance 4965e258-30ca-4b70-ab5a-9f78a973c53d on hv-cinder-81080 Sep 24 03:41:53.064034 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-54d48664-5cd4-4e34-abbb-856614d3fa85 req-26102906-e409-499b-b17b-b71d070b5a1c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112643 Sep 24 03:41:53.064653 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 572/1138] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:41:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:41:53.949059 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8b29385c-7d7d-4516-ae64-f3118ecacc7f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:53.949590 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8b29385c-7d7d-4516-ae64-f3118ecacc7f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:53.955374 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8b29385c-7d7d-4516-ae64-f3118ecacc7f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:53.955813 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8b29385c-7d7d-4516-ae64-f3118ecacc7f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:53.956581 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8b29385c-7d7d-4516-ae64-f3118ecacc7f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:53.957168 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8b29385c-7d7d-4516-ae64-f3118ecacc7f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:53.972917 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-8b29385c-7d7d-4516-ae64-f3118ecacc7f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] HTTP exception thrown: Instance 4965e258-30ca-4b70-ab5a-9f78a973c53d could not be found. Sep 24 03:41:53.973501 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8b29385c-7d7d-4516-ae64-f3118ecacc7f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Returning 404 to user: Instance 4965e258-30ca-4b70-ab5a-9f78a973c53d could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:41:53.974538 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8b29385c-7d7d-4516-ae64-f3118ecacc7f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 404 len: 111 microversion: 2.1 time: 0.029966 Sep 24 03:41:53.975091 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 567/1139] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:41:53 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:41:54.073858 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1011238651", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1127999244", "security_groups": [{"name": "tempest-secgroup-smoke-1084952511"}], "block_device_mapping_v2": [{"uuid": "68dce92e-540d-4722-bbb7-8bec24b21097", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2db2bbde-716b-483e-ab4b-d8be258587c3"}]}} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:41:54.176263 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.network.neutron [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] validate_networks() for [('2db2bbde-716b-483e-ab4b-d8be258587c3', None, None, None, None, None)] {{(pid=109374) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:41:54.594498 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Flavor limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:41:54.595001 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Image limits 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:41:54.595795 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Flavor pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:41:54.596207 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Image pref 0:0:0 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:41:54.596619 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.virt.hardware [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:41:54.606954 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:54.607394 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:54.608220 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:54.608651 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:54.625460 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Getting quotas for project 6dfe51f1a692492e80a0c7c5a9078e73. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:41:54.629314 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.quota [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Getting quotas for user 9ee5b6094e3b48739df3c797dfcc4edc and project 6dfe51f1a692492e80a0c7c5a9078e73. Resources: {'cores', 'instances', 'ram'} {{(pid=109374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:41:54.689127 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Going to run 1 instances... {{(pid=109374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:41:54.692702 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68dce92e-540d-4722-bbb7-8bec24b21097',volume_size=None,volume_type=None)] {{(pid=109374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:41:54.815049 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-35f61ab3-fbf0-45ee-8b07-a964ad4f9c63 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745456 Sep 24 03:41:54.815688 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 573/1140] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:41:54 2021] POST /compute/v2.1/servers => generated 406 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:41:54.825382 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5602c2d4-8c88-4430-949d-ec2cd32dfb0a tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:54.826110 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5602c2d4-8c88-4430-949d-ec2cd32dfb0a tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:54.886395 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5602c2d4-8c88-4430-949d-ec2cd32dfb0a tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:41:54.892691 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5602c2d4-8c88-4430-949d-ec2cd32dfb0a tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1095 microversion: 2.1 time: 0.071095 Sep 24 03:41:54.893327 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 568/1141] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:41:54 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:41:55.911960 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-275874b6-0b6f-4908-863e-7d1b43e5fd12 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:55.912693 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-275874b6-0b6f-4908-863e-7d1b43e5fd12 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:55.919837 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-275874b6-0b6f-4908-863e-7d1b43e5fd12 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:55.920280 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-275874b6-0b6f-4908-863e-7d1b43e5fd12 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:55.921052 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-275874b6-0b6f-4908-863e-7d1b43e5fd12 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:55.921478 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-275874b6-0b6f-4908-863e-7d1b43e5fd12 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:56.019647 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-275874b6-0b6f-4908-863e-7d1b43e5fd12 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:41:56.027402 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-275874b6-0b6f-4908-863e-7d1b43e5fd12 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1211 microversion: 2.1 time: 0.121047 Sep 24 03:41:56.027978 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 574/1142] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:41:55 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1211 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:41:57.044354 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-4fe64b7d-94be-4e62-be87-2d3f8dcc0c22 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:57.044945 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-4fe64b7d-94be-4e62-be87-2d3f8dcc0c22 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:57.051106 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4fe64b7d-94be-4e62-be87-2d3f8dcc0c22 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:57.051750 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4fe64b7d-94be-4e62-be87-2d3f8dcc0c22 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:57.052618 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4fe64b7d-94be-4e62-be87-2d3f8dcc0c22 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:57.053243 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4fe64b7d-94be-4e62-be87-2d3f8dcc0c22 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:57.226623 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-835d573e-a134-49ae-825c-97f0c968309c req-550f745c-8816-4d20-aa78-f2ba2485dcae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987027b6-5096-480c-ba2a-8536b27fe070", "tag": "03ed0ec4-0b4c-409a-97e8-50682cefa193"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:41:57.231097 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:41:57.231097 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:41:57.245266 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-835d573e-a134-49ae-825c-97f0c968309c req-550f745c-8816-4d20-aa78-f2ba2485dcae service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:57.245786 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-835d573e-a134-49ae-825c-97f0c968309c req-550f745c-8816-4d20-aa78-f2ba2485dcae service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:57.259011 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-835d573e-a134-49ae-825c-97f0c968309c req-550f745c-8816-4d20-aa78-f2ba2485dcae service nova] Creating event network-changed:03ed0ec4-0b4c-409a-97e8-50682cefa193 for instance 987027b6-5096-480c-ba2a-8536b27fe070 on hv-cinder-81080 Sep 24 03:41:57.265955 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-835d573e-a134-49ae-825c-97f0c968309c req-550f745c-8816-4d20-aa78-f2ba2485dcae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044140 Sep 24 03:41:57.267124 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 575/1143] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:41:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:41:57.270793 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4fe64b7d-94be-4e62-be87-2d3f8dcc0c22 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:41:57.279802 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-4fe64b7d-94be-4e62-be87-2d3f8dcc0c22 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1267 microversion: 2.1 time: 0.239324 Sep 24 03:41:57.280376 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 569/1144] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:41:57 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:41:58.296746 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-148e00cb-4dae-4c6f-9daa-9593a7ae417d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:58.297437 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-148e00cb-4dae-4c6f-9daa-9593a7ae417d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:58.303456 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-148e00cb-4dae-4c6f-9daa-9593a7ae417d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:58.303848 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-148e00cb-4dae-4c6f-9daa-9593a7ae417d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:58.304607 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-148e00cb-4dae-4c6f-9daa-9593a7ae417d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:58.305032 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-148e00cb-4dae-4c6f-9daa-9593a7ae417d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:58.424945 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-148e00cb-4dae-4c6f-9daa-9593a7ae417d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:41:58.432792 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-148e00cb-4dae-4c6f-9daa-9593a7ae417d tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1267 microversion: 2.1 time: 0.140055 Sep 24 03:41:58.433375 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 576/1145] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:41:58 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:41:59.449157 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-786a7fe7-374e-42ae-b335-7470d6c4a50c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:41:59.449782 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-786a7fe7-374e-42ae-b335-7470d6c4a50c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:41:59.457426 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-786a7fe7-374e-42ae-b335-7470d6c4a50c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:59.457908 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-786a7fe7-374e-42ae-b335-7470d6c4a50c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:59.458674 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-786a7fe7-374e-42ae-b335-7470d6c4a50c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:41:59.459102 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-786a7fe7-374e-42ae-b335-7470d6c4a50c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:41:59.577966 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-786a7fe7-374e-42ae-b335-7470d6c4a50c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:41:59.585262 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-786a7fe7-374e-42ae-b335-7470d6c4a50c tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1267 microversion: 2.1 time: 0.139980 Sep 24 03:41:59.585851 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 570/1146] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:41:59 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:42:00.602480 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0676ca8c-a682-4b5a-a7d6-a17857019088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:42:00.603354 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0676ca8c-a682-4b5a-a7d6-a17857019088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:42:00.610335 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0676ca8c-a682-4b5a-a7d6-a17857019088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:00.610779 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0676ca8c-a682-4b5a-a7d6-a17857019088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:00.611555 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0676ca8c-a682-4b5a-a7d6-a17857019088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:00.611981 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-0676ca8c-a682-4b5a-a7d6-a17857019088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:00.738023 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0676ca8c-a682-4b5a-a7d6-a17857019088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:42:00.745875 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0676ca8c-a682-4b5a-a7d6-a17857019088 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1267 microversion: 2.1 time: 0.147118 Sep 24 03:42:00.746446 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 577/1147] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:42:00 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:42:01.762115 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-711cb86c-c476-4a31-a95e-caaf841f40c9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:42:01.762736 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-711cb86c-c476-4a31-a95e-caaf841f40c9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:42:01.768484 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-711cb86c-c476-4a31-a95e-caaf841f40c9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:01.768917 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-711cb86c-c476-4a31-a95e-caaf841f40c9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:01.769662 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-711cb86c-c476-4a31-a95e-caaf841f40c9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:01.770103 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-711cb86c-c476-4a31-a95e-caaf841f40c9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:01.889257 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-711cb86c-c476-4a31-a95e-caaf841f40c9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:42:01.896357 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-711cb86c-c476-4a31-a95e-caaf841f40c9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1267 microversion: 2.1 time: 0.137896 Sep 24 03:42:01.896904 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 571/1148] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:42:01 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:42:02.913741 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5bf12a99-2ff0-465a-924f-5d8f506b7d39 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:42:02.914367 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5bf12a99-2ff0-465a-924f-5d8f506b7d39 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:42:02.920752 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5bf12a99-2ff0-465a-924f-5d8f506b7d39 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:02.921199 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5bf12a99-2ff0-465a-924f-5d8f506b7d39 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:02.921990 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5bf12a99-2ff0-465a-924f-5d8f506b7d39 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:02.922419 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5bf12a99-2ff0-465a-924f-5d8f506b7d39 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:03.042502 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-5bf12a99-2ff0-465a-924f-5d8f506b7d39 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:42:03.049584 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5bf12a99-2ff0-465a-924f-5d8f506b7d39 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1267 microversion: 2.1 time: 0.139515 Sep 24 03:42:03.050165 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 578/1149] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:42:02 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:42:04.066485 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1a066977-ba0e-44c4-aa3e-6cfe1b9c9317 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:42:04.067235 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1a066977-ba0e-44c4-aa3e-6cfe1b9c9317 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:42:04.073179 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1a066977-ba0e-44c4-aa3e-6cfe1b9c9317 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:04.073615 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1a066977-ba0e-44c4-aa3e-6cfe1b9c9317 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:04.074396 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1a066977-ba0e-44c4-aa3e-6cfe1b9c9317 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:04.074822 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1a066977-ba0e-44c4-aa3e-6cfe1b9c9317 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:04.195629 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1a066977-ba0e-44c4-aa3e-6cfe1b9c9317 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:42:04.203255 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1a066977-ba0e-44c4-aa3e-6cfe1b9c9317 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1267 microversion: 2.1 time: 0.140374 Sep 24 03:42:04.203810 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 572/1150] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:42:04 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:42:05.220254 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-aa1335e5-02a4-4772-aa7f-d084e831fbd9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:42:05.220871 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-aa1335e5-02a4-4772-aa7f-d084e831fbd9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:42:05.226632 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa1335e5-02a4-4772-aa7f-d084e831fbd9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:05.227070 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa1335e5-02a4-4772-aa7f-d084e831fbd9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:05.228434 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa1335e5-02a4-4772-aa7f-d084e831fbd9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:05.228941 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-aa1335e5-02a4-4772-aa7f-d084e831fbd9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:05.501326 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-aa1335e5-02a4-4772-aa7f-d084e831fbd9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:42:05.508589 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-aa1335e5-02a4-4772-aa7f-d084e831fbd9 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1267 microversion: 2.1 time: 0.291915 Sep 24 03:42:05.509755 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 579/1151] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:42:05 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1267 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:42:06.525987 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-87dfa757-bb10-47f2-b25d-035f97421e47 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:42:06.526616 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-87dfa757-bb10-47f2-b25d-035f97421e47 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:42:06.532484 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-87dfa757-bb10-47f2-b25d-035f97421e47 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:06.532918 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-87dfa757-bb10-47f2-b25d-035f97421e47 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:06.533672 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-87dfa757-bb10-47f2-b25d-035f97421e47 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:06.534141 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-87dfa757-bb10-47f2-b25d-035f97421e47 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:06.650599 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-87dfa757-bb10-47f2-b25d-035f97421e47 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:42:06.657649 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-87dfa757-bb10-47f2-b25d-035f97421e47 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1267 microversion: 2.1 time: 0.135623 Sep 24 03:42:06.658232 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 573/1152] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:42:06 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:42:07.560983 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-51f2496a-8ad9-40d2-b052-8fd713f3a8b2 req-082faf9f-2be1-46a1-8307-fa57e82a005f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987027b6-5096-480c-ba2a-8536b27fe070", "name": "network-vif-plugged", "status": "completed", "tag": "03ed0ec4-0b4c-409a-97e8-50682cefa193"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:42:07.562541 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:42:07.562541 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:42:07.570049 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-51f2496a-8ad9-40d2-b052-8fd713f3a8b2 req-082faf9f-2be1-46a1-8307-fa57e82a005f service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:07.570492 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-51f2496a-8ad9-40d2-b052-8fd713f3a8b2 req-082faf9f-2be1-46a1-8307-fa57e82a005f service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:07.581944 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-51f2496a-8ad9-40d2-b052-8fd713f3a8b2 req-082faf9f-2be1-46a1-8307-fa57e82a005f service nova] Creating event network-vif-plugged:03ed0ec4-0b4c-409a-97e8-50682cefa193 for instance 987027b6-5096-480c-ba2a-8536b27fe070 on hv-cinder-81080 Sep 24 03:42:07.586922 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-51f2496a-8ad9-40d2-b052-8fd713f3a8b2 req-082faf9f-2be1-46a1-8307-fa57e82a005f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086581 Sep 24 03:42:07.587527 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 580/1153] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:42:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:42:07.674633 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-2560fdd3-3cae-4887-9db4-d35f9a166223 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:42:07.675207 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-2560fdd3-3cae-4887-9db4-d35f9a166223 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:42:07.681592 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2560fdd3-3cae-4887-9db4-d35f9a166223 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:07.682081 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2560fdd3-3cae-4887-9db4-d35f9a166223 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:07.682813 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2560fdd3-3cae-4887-9db4-d35f9a166223 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:07.683232 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-2560fdd3-3cae-4887-9db4-d35f9a166223 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:07.841428 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-2560fdd3-3cae-4887-9db4-d35f9a166223 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:42:07.848776 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-2560fdd3-3cae-4887-9db4-d35f9a166223 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1267 microversion: 2.1 time: 0.177810 Sep 24 03:42:07.849351 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 574/1154] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:42:07 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:42:08.866324 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8f78fb24-c87b-4596-a876-ed766fcef829 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:42:08.867071 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8f78fb24-c87b-4596-a876-ed766fcef829 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:42:08.874635 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8f78fb24-c87b-4596-a876-ed766fcef829 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:08.875054 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8f78fb24-c87b-4596-a876-ed766fcef829 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:08.875809 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8f78fb24-c87b-4596-a876-ed766fcef829 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:08.876226 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8f78fb24-c87b-4596-a876-ed766fcef829 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:08.998163 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-8f78fb24-c87b-4596-a876-ed766fcef829 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:42:09.005578 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8f78fb24-c87b-4596-a876-ed766fcef829 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1454 microversion: 2.1 time: 0.143352 Sep 24 03:42:09.006233 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 581/1155] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:42:08 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:42:09.023776 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-fbb7184a-46d6-47ea-a9d2-ab5054dd8f76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:42:09.024478 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-fbb7184a-46d6-47ea-a9d2-ab5054dd8f76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:42:09.031058 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fbb7184a-46d6-47ea-a9d2-ab5054dd8f76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:09.031498 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fbb7184a-46d6-47ea-a9d2-ab5054dd8f76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:09.032263 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fbb7184a-46d6-47ea-a9d2-ab5054dd8f76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:09.032691 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-fbb7184a-46d6-47ea-a9d2-ab5054dd8f76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:09.151344 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-fbb7184a-46d6-47ea-a9d2-ab5054dd8f76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:42:09.158613 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-fbb7184a-46d6-47ea-a9d2-ab5054dd8f76 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1454 microversion: 2.1 time: 0.140515 Sep 24 03:42:09.159183 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 575/1156] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:42:09 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:42:10.955290 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-d0056d88-3964-4ba8-b497-589a6c654906 req-f8a296a4-4b06-4c41-a09d-1466ad7f4736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987027b6-5096-480c-ba2a-8536b27fe070", "tag": "03ed0ec4-0b4c-409a-97e8-50682cefa193"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:42:10.956986 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:42:10.956986 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:42:10.970198 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-d0056d88-3964-4ba8-b497-589a6c654906 req-f8a296a4-4b06-4c41-a09d-1466ad7f4736 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:42:10.971575 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-d0056d88-3964-4ba8-b497-589a6c654906 req-f8a296a4-4b06-4c41-a09d-1466ad7f4736 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:42:10.983330 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-d0056d88-3964-4ba8-b497-589a6c654906 req-f8a296a4-4b06-4c41-a09d-1466ad7f4736 service nova] Creating event network-changed:03ed0ec4-0b4c-409a-97e8-50682cefa193 for instance 987027b6-5096-480c-ba2a-8536b27fe070 on hv-cinder-81080 Sep 24 03:42:10.988243 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-d0056d88-3964-4ba8-b497-589a6c654906 req-f8a296a4-4b06-4c41-a09d-1466ad7f4736 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036579 Sep 24 03:42:10.988820 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 582/1157] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:42:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:43:41.120307 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 03:43:41.120832 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: Fri Sep 24 03:43:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 24 03:43:44.866954 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-176092219", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1127999244", "security_groups": [{"name": "tempest-secgroup-smoke-1084952511"}], "block_device_mapping_v2": [{"uuid": "7ac97e47-7a8d-4a64-ad82-b4ece34237fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2db2bbde-716b-483e-ab4b-d8be258587c3"}]}} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:43:44.968284 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.network.neutron [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] validate_networks() for [('2db2bbde-716b-483e-ab4b-d8be258587c3', None, None, None, None, None)] {{(pid=109375) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 24 03:43:45.388744 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Flavor limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 03:43:45.389374 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Image limits 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 03:43:45.390020 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Flavor pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 03:43:45.390423 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Image pref 0:0:0 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 03:43:45.391010 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.virt.hardware [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=109375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 03:43:45.399504 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:45.399934 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:45.400729 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:45.401252 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:45.418284 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Getting quotas for project 6dfe51f1a692492e80a0c7c5a9078e73. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 24 03:43:45.423117 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.quota [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Getting quotas for user 9ee5b6094e3b48739df3c797dfcc4edc and project 6dfe51f1a692492e80a0c7c5a9078e73. Resources: {'cores', 'instances', 'ram'} {{(pid=109375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 24 03:43:45.484784 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Going to run 1 instances... {{(pid=109375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 24 03:43:45.487085 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ac97e47-7a8d-4a64-ad82-b4ece34237fe',volume_size=None,volume_type=None)] {{(pid=109375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 24 03:43:45.608514 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-43f107d9-c914-4e3e-9227-ee8562a632c0 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745503 Sep 24 03:43:45.609180 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 576/1158] 10.222.0.18 () {60 vars in 1147 bytes} [Fri Sep 24 03:43:44 2021] POST /compute/v2.1/servers => generated 406 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 03:43:45.620727 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-0d534104-b710-499b-86c0-dfb793329a6e tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:45.621418 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-0d534104-b710-499b-86c0-dfb793329a6e tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:45.675096 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-0d534104-b710-499b-86c0-dfb793329a6e tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:45.681455 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-0d534104-b710-499b-86c0-dfb793329a6e tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1094 microversion: 2.1 time: 0.066175 Sep 24 03:43:45.682244 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 583/1159] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:45 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:43:46.698807 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b823797d-7339-43d6-9f6b-8bf04ac4ca32 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:46.699406 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b823797d-7339-43d6-9f6b-8bf04ac4ca32 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:46.705937 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b823797d-7339-43d6-9f6b-8bf04ac4ca32 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:46.706376 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b823797d-7339-43d6-9f6b-8bf04ac4ca32 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:46.707138 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b823797d-7339-43d6-9f6b-8bf04ac4ca32 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:46.707557 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b823797d-7339-43d6-9f6b-8bf04ac4ca32 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:46.773159 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b823797d-7339-43d6-9f6b-8bf04ac4ca32 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:46.781028 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b823797d-7339-43d6-9f6b-8bf04ac4ca32 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1210 microversion: 2.1 time: 0.085908 Sep 24 03:43:46.781590 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 577/1160] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:46 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:43:47.797374 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-71af8c76-0b8a-4924-9399-e7e171568b98 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:47.798004 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-71af8c76-0b8a-4924-9399-e7e171568b98 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:47.804842 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-71af8c76-0b8a-4924-9399-e7e171568b98 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:47.805245 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-71af8c76-0b8a-4924-9399-e7e171568b98 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:47.806218 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-71af8c76-0b8a-4924-9399-e7e171568b98 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:47.806645 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-71af8c76-0b8a-4924-9399-e7e171568b98 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:47.841467 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-a01330e5-b7a9-43fe-8dd7-3842b74dd00a req-89315ba9-ac57-4b7e-bc86-66912cc48d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0552e2ca-104c-4100-ac8c-aa9ea0460cd4", "tag": "59949c75-d4af-428d-acd5-0e2fd2a59d20"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:43:47.844166 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:43:47.844166 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:43:47.852100 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-a01330e5-b7a9-43fe-8dd7-3842b74dd00a req-89315ba9-ac57-4b7e-bc86-66912cc48d48 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:47.852538 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-a01330e5-b7a9-43fe-8dd7-3842b74dd00a req-89315ba9-ac57-4b7e-bc86-66912cc48d48 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:47.864717 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-a01330e5-b7a9-43fe-8dd7-3842b74dd00a req-89315ba9-ac57-4b7e-bc86-66912cc48d48 service nova] Creating event network-changed:59949c75-d4af-428d-acd5-0e2fd2a59d20 for instance 0552e2ca-104c-4100-ac8c-aa9ea0460cd4 on hv-cinder-81080 Sep 24 03:43:47.870828 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-a01330e5-b7a9-43fe-8dd7-3842b74dd00a req-89315ba9-ac57-4b7e-bc86-66912cc48d48 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032996 Sep 24 03:43:47.871949 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 578/1161] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:43:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 03:43:48.052112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-71af8c76-0b8a-4924-9399-e7e171568b98 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:48.059566 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-71af8c76-0b8a-4924-9399-e7e171568b98 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1266 microversion: 2.1 time: 0.265678 Sep 24 03:43:48.060061 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 584/1162] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:47 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:43:49.077273 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-8312c428-25b3-42ec-a974-b010b4e07055 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:49.078025 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-8312c428-25b3-42ec-a974-b010b4e07055 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:49.084276 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8312c428-25b3-42ec-a974-b010b4e07055 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:49.084722 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8312c428-25b3-42ec-a974-b010b4e07055 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:49.085494 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8312c428-25b3-42ec-a974-b010b4e07055 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:49.085949 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-8312c428-25b3-42ec-a974-b010b4e07055 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:49.206958 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-8312c428-25b3-42ec-a974-b010b4e07055 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:49.214325 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-8312c428-25b3-42ec-a974-b010b4e07055 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1266 microversion: 2.1 time: 0.141734 Sep 24 03:43:49.214888 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 579/1163] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:49 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:43:50.232037 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-9bc339c9-66a3-47fc-af35-4dd360eb6357 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:50.232549 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-9bc339c9-66a3-47fc-af35-4dd360eb6357 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:50.238578 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9bc339c9-66a3-47fc-af35-4dd360eb6357 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:50.239025 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9bc339c9-66a3-47fc-af35-4dd360eb6357 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:50.239783 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9bc339c9-66a3-47fc-af35-4dd360eb6357 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:50.240216 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-9bc339c9-66a3-47fc-af35-4dd360eb6357 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:50.358421 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-9bc339c9-66a3-47fc-af35-4dd360eb6357 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:50.365779 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-9bc339c9-66a3-47fc-af35-4dd360eb6357 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1266 microversion: 2.1 time: 0.137938 Sep 24 03:43:50.366340 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 585/1164] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:50 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:43:51.383100 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-09948ab3-a42d-4008-9f54-53d3f97304d4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:51.383683 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-09948ab3-a42d-4008-9f54-53d3f97304d4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:51.390158 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-09948ab3-a42d-4008-9f54-53d3f97304d4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:51.390596 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-09948ab3-a42d-4008-9f54-53d3f97304d4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:51.391345 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-09948ab3-a42d-4008-9f54-53d3f97304d4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:51.391765 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-09948ab3-a42d-4008-9f54-53d3f97304d4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:51.513624 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-09948ab3-a42d-4008-9f54-53d3f97304d4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:51.521483 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-09948ab3-a42d-4008-9f54-53d3f97304d4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1266 microversion: 2.1 time: 0.142114 Sep 24 03:43:51.522086 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 580/1165] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:51 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:43:52.538042 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-72bf688f-a1be-4a2c-b657-fa5b4e2e3f69 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:52.538651 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-72bf688f-a1be-4a2c-b657-fa5b4e2e3f69 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:52.544508 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-72bf688f-a1be-4a2c-b657-fa5b4e2e3f69 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:52.544953 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-72bf688f-a1be-4a2c-b657-fa5b4e2e3f69 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:52.545892 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-72bf688f-a1be-4a2c-b657-fa5b4e2e3f69 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:52.546329 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-72bf688f-a1be-4a2c-b657-fa5b4e2e3f69 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:52.663940 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-72bf688f-a1be-4a2c-b657-fa5b4e2e3f69 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:52.671203 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-72bf688f-a1be-4a2c-b657-fa5b4e2e3f69 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1266 microversion: 2.1 time: 0.136823 Sep 24 03:43:52.671751 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 586/1166] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:52 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:43:53.688266 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-d46baae8-76ae-4851-a6ce-c021ae1b7727 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:53.688895 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-d46baae8-76ae-4851-a6ce-c021ae1b7727 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:53.694749 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d46baae8-76ae-4851-a6ce-c021ae1b7727 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:53.695186 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d46baae8-76ae-4851-a6ce-c021ae1b7727 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:53.695944 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d46baae8-76ae-4851-a6ce-c021ae1b7727 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:53.696363 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-d46baae8-76ae-4851-a6ce-c021ae1b7727 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:53.814641 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-d46baae8-76ae-4851-a6ce-c021ae1b7727 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:53.821868 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-d46baae8-76ae-4851-a6ce-c021ae1b7727 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1266 microversion: 2.1 time: 0.138023 Sep 24 03:43:53.822433 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 581/1167] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:53 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:43:54.838579 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-e973100b-04d0-4571-b5c7-5b7f7c7b3956 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:54.839178 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-e973100b-04d0-4571-b5c7-5b7f7c7b3956 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:54.845698 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e973100b-04d0-4571-b5c7-5b7f7c7b3956 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:54.846153 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e973100b-04d0-4571-b5c7-5b7f7c7b3956 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:54.846911 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e973100b-04d0-4571-b5c7-5b7f7c7b3956 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:54.847332 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-e973100b-04d0-4571-b5c7-5b7f7c7b3956 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:54.969160 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-e973100b-04d0-4571-b5c7-5b7f7c7b3956 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:54.976292 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-e973100b-04d0-4571-b5c7-5b7f7c7b3956 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1266 microversion: 2.1 time: 0.141351 Sep 24 03:43:54.976846 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 587/1168] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:54 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:43:55.992165 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b5644a16-e5e3-4304-b556-dab75f5dc731 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:55.992772 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b5644a16-e5e3-4304-b556-dab75f5dc731 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:55.998587 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b5644a16-e5e3-4304-b556-dab75f5dc731 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:55.999026 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b5644a16-e5e3-4304-b556-dab75f5dc731 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:55.999782 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b5644a16-e5e3-4304-b556-dab75f5dc731 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:56.000202 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b5644a16-e5e3-4304-b556-dab75f5dc731 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:56.119381 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b5644a16-e5e3-4304-b556-dab75f5dc731 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:56.126762 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b5644a16-e5e3-4304-b556-dab75f5dc731 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1266 microversion: 2.1 time: 0.138215 Sep 24 03:43:56.127325 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 582/1169] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:55 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:43:57.143845 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-50a71246-0768-4c50-87d6-bda4b2aaee8a tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:57.144410 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-50a71246-0768-4c50-87d6-bda4b2aaee8a tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:57.150202 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-50a71246-0768-4c50-87d6-bda4b2aaee8a tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:57.150645 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-50a71246-0768-4c50-87d6-bda4b2aaee8a tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:57.151406 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-50a71246-0768-4c50-87d6-bda4b2aaee8a tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:57.151834 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-50a71246-0768-4c50-87d6-bda4b2aaee8a tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:57.267867 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-50a71246-0768-4c50-87d6-bda4b2aaee8a tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:57.275044 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-50a71246-0768-4c50-87d6-bda4b2aaee8a tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1266 microversion: 2.1 time: 0.135523 Sep 24 03:43:57.275596 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 588/1170] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:57 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:43:57.980794 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-41d595bb-58d6-46d2-adb3-a0b30a82bfa5 req-c02b7de7-0ae1-4e25-9c6d-f0c85b80315a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0552e2ca-104c-4100-ac8c-aa9ea0460cd4", "name": "network-vif-plugged", "status": "completed", "tag": "59949c75-d4af-428d-acd5-0e2fd2a59d20"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:43:57.982320 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:43:57.982320 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:43:57.990018 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-41d595bb-58d6-46d2-adb3-a0b30a82bfa5 req-c02b7de7-0ae1-4e25-9c6d-f0c85b80315a service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:57.990455 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-41d595bb-58d6-46d2-adb3-a0b30a82bfa5 req-c02b7de7-0ae1-4e25-9c6d-f0c85b80315a service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:58.001902 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-41d595bb-58d6-46d2-adb3-a0b30a82bfa5 req-c02b7de7-0ae1-4e25-9c6d-f0c85b80315a service nova] Creating event network-vif-plugged:59949c75-d4af-428d-acd5-0e2fd2a59d20 for instance 0552e2ca-104c-4100-ac8c-aa9ea0460cd4 on hv-cinder-81080 Sep 24 03:43:58.006890 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-41d595bb-58d6-46d2-adb3-a0b30a82bfa5 req-c02b7de7-0ae1-4e25-9c6d-f0c85b80315a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030028 Sep 24 03:43:58.007472 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 583/1171] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:43:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:43:58.291268 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-cd6cd108-8ff4-4e52-a4fc-587d839443fd tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:58.291877 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-cd6cd108-8ff4-4e52-a4fc-587d839443fd tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:58.298220 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cd6cd108-8ff4-4e52-a4fc-587d839443fd tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:58.298668 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cd6cd108-8ff4-4e52-a4fc-587d839443fd tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:58.299437 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cd6cd108-8ff4-4e52-a4fc-587d839443fd tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:58.299864 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-cd6cd108-8ff4-4e52-a4fc-587d839443fd tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:58.418112 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-cd6cd108-8ff4-4e52-a4fc-587d839443fd tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:58.425381 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-cd6cd108-8ff4-4e52-a4fc-587d839443fd tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1266 microversion: 2.1 time: 0.137800 Sep 24 03:43:58.425975 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 589/1172] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:58 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:43:59.442832 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-5b565972-12fa-41a1-a0a8-c7ab889e076f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:59.443532 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-5b565972-12fa-41a1-a0a8-c7ab889e076f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:59.449577 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5b565972-12fa-41a1-a0a8-c7ab889e076f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:59.450048 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5b565972-12fa-41a1-a0a8-c7ab889e076f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:59.450802 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5b565972-12fa-41a1-a0a8-c7ab889e076f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:59.451228 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-5b565972-12fa-41a1-a0a8-c7ab889e076f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:59.572897 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-5b565972-12fa-41a1-a0a8-c7ab889e076f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:59.580422 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-5b565972-12fa-41a1-a0a8-c7ab889e076f tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1454 microversion: 2.1 time: 0.141594 Sep 24 03:43:59.580985 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 584/1173] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:59 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:43:59.596234 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-a76f26de-8fda-4a23-8332-e7809d7167d2 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:43:59.596837 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-a76f26de-8fda-4a23-8332-e7809d7167d2 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:43:59.602509 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a76f26de-8fda-4a23-8332-e7809d7167d2 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:59.602950 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a76f26de-8fda-4a23-8332-e7809d7167d2 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:59.603708 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a76f26de-8fda-4a23-8332-e7809d7167d2 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:43:59.604132 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-a76f26de-8fda-4a23-8332-e7809d7167d2 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:43:59.739394 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-a76f26de-8fda-4a23-8332-e7809d7167d2 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:43:59.746610 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-a76f26de-8fda-4a23-8332-e7809d7167d2 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1454 microversion: 2.1 time: 0.154468 Sep 24 03:43:59.747169 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 590/1174] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:43:59 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:44:01.288800 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-3ba76ad2-7678-4b05-b2e4-809cc774bcad req-2169d163-7540-48b9-8b27-1d5bbbe0ee75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0552e2ca-104c-4100-ac8c-aa9ea0460cd4", "tag": "59949c75-d4af-428d-acd5-0e2fd2a59d20"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:44:01.291330 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:44:01.291330 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:44:01.299072 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-3ba76ad2-7678-4b05-b2e4-809cc774bcad req-2169d163-7540-48b9-8b27-1d5bbbe0ee75 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:44:01.299534 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-3ba76ad2-7678-4b05-b2e4-809cc774bcad req-2169d163-7540-48b9-8b27-1d5bbbe0ee75 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:44:01.310271 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-3ba76ad2-7678-4b05-b2e4-809cc774bcad req-2169d163-7540-48b9-8b27-1d5bbbe0ee75 service nova] Creating event network-changed:59949c75-d4af-428d-acd5-0e2fd2a59d20 for instance 0552e2ca-104c-4100-ac8c-aa9ea0460cd4 on hv-cinder-81080 Sep 24 03:44:01.315694 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-3ba76ad2-7678-4b05-b2e4-809cc774bcad req-2169d163-7540-48b9-8b27-1d5bbbe0ee75 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030654 Sep 24 03:44:01.316378 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 585/1175] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:44:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:44:45.294948 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 03:44:45.295425 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: Fri Sep 24 03:44:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 24 03:44:57.560356 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 03:44:57.561008 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: Fri Sep 24 03:44:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 24 03:45:05.591270 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 03:45:05.591935 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: Fri Sep 24 03:45:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 24 03:45:29.536614 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9b7c824-2b2f-40a5-baaf-117cd6cabeb5] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 03:45:29.544330 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-5217847d-8290-4266-a1e4-cf9f78a8d1b7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:45:29.544822 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5217847d-8290-4266-a1e4-cf9f78a8d1b7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:45:29.552187 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5217847d-8290-4266-a1e4-cf9f78a8d1b7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:29.552780 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5217847d-8290-4266-a1e4-cf9f78a8d1b7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:29.554094 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5217847d-8290-4266-a1e4-cf9f78a8d1b7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:29.554821 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-5217847d-8290-4266-a1e4-cf9f78a8d1b7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:29.591460 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-5217847d-8290-4266-a1e4-cf9f78a8d1b7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Going to try to terminate instance {{(pid=109374) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:45:29.651988 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [req-8555815c-391b-4e9d-bc2c-a92cf51e13bd req-8bb75388-a5a5-42b8-9c7c-4424b717fe76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0552e2ca-104c-4100-ac8c-aa9ea0460cd4", "tag": "59949c75-d4af-428d-acd5-0e2fd2a59d20"}]} {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:45:29.653695 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:45:29.653695 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: warnings.warn(msg) Sep 24 03:45:29.661280 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-8555815c-391b-4e9d-bc2c-a92cf51e13bd req-8bb75388-a5a5-42b8-9c7c-4424b717fe76 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:29.661823 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [req-8555815c-391b-4e9d-bc2c-a92cf51e13bd req-8bb75388-a5a5-42b8-9c7c-4424b717fe76 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:29.673337 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.compute.server_external_events [req-8555815c-391b-4e9d-bc2c-a92cf51e13bd req-8bb75388-a5a5-42b8-9c7c-4424b717fe76 service nova] Creating event network-changed:59949c75-d4af-428d-acd5-0e2fd2a59d20 for instance 0552e2ca-104c-4100-ac8c-aa9ea0460cd4 on hv-cinder-81080 Sep 24 03:45:29.674589 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-5217847d-8290-4266-a1e4-cf9f78a8d1b7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 204 len: 0 microversion: 2.1 time: 0.142304 Sep 24 03:45:29.675321 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 591/1176] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:45:29 2021] DELETE /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:45:29.681217 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [req-8555815c-391b-4e9d-bc2c-a92cf51e13bd req-8bb75388-a5a5-42b8-9c7c-4424b717fe76 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146897 Sep 24 03:45:29.682518 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 586/1177] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:45:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:45:29.684739 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-7cdb3177-37ca-4d04-b9a9-013b50056bb4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:45:29.685502 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-7cdb3177-37ca-4d04-b9a9-013b50056bb4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:45:29.696169 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7cdb3177-37ca-4d04-b9a9-013b50056bb4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:29.696623 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7cdb3177-37ca-4d04-b9a9-013b50056bb4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:29.697429 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7cdb3177-37ca-4d04-b9a9-013b50056bb4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:29.697857 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-7cdb3177-37ca-4d04-b9a9-013b50056bb4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:29.898914 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-7cdb3177-37ca-4d04-b9a9-013b50056bb4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:45:29.914162 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-7cdb3177-37ca-4d04-b9a9-013b50056bb4 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1579 microversion: 2.1 time: 0.233512 Sep 24 03:45:29.914964 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 592/1178] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:45:29 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1579 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 03:45:30.942310 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-473363e9-b600-4818-8ff2-aed349aa0a1b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:45:30.943009 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-473363e9-b600-4818-8ff2-aed349aa0a1b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:45:30.950055 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-473363e9-b600-4818-8ff2-aed349aa0a1b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:30.950435 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-473363e9-b600-4818-8ff2-aed349aa0a1b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:30.951195 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-473363e9-b600-4818-8ff2-aed349aa0a1b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:30.951620 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-473363e9-b600-4818-8ff2-aed349aa0a1b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:30.956596 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9b7c824-2b2f-40a5-baaf-117cd6cabeb5] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 54762. Sep 24 03:45:31.075873 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-473363e9-b600-4818-8ff2-aed349aa0a1b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:45:31.083199 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-473363e9-b600-4818-8ff2-aed349aa0a1b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1460 microversion: 2.1 time: 0.155360 Sep 24 03:45:31.083750 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 587/1179] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:45:30 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1460 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:45:31.708867 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-2a218e34-ae1a-40f0-a14c-92aa78190020 req-da78c3c0-6964-4cae-b368-c0bbfed5a99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0552e2ca-104c-4100-ac8c-aa9ea0460cd4", "name": "network-vif-deleted", "tag": "59949c75-d4af-428d-acd5-0e2fd2a59d20"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:45:31.710878 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:45:31.710878 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:45:31.718277 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-2a218e34-ae1a-40f0-a14c-92aa78190020 req-da78c3c0-6964-4cae-b368-c0bbfed5a99d service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:31.718732 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-2a218e34-ae1a-40f0-a14c-92aa78190020 req-da78c3c0-6964-4cae-b368-c0bbfed5a99d service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:31.730451 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-2a218e34-ae1a-40f0-a14c-92aa78190020 req-da78c3c0-6964-4cae-b368-c0bbfed5a99d service nova] Creating event network-vif-deleted:59949c75-d4af-428d-acd5-0e2fd2a59d20 for instance 0552e2ca-104c-4100-ac8c-aa9ea0460cd4 on hv-cinder-81080 Sep 24 03:45:31.735295 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-2a218e34-ae1a-40f0-a14c-92aa78190020 req-da78c3c0-6964-4cae-b368-c0bbfed5a99d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030384 Sep 24 03:45:31.735866 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 593/1180] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:45:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:45:32.100730 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-1f885bef-a74a-411b-9429-ac931aa7dd29 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:45:32.101424 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-1f885bef-a74a-411b-9429-ac931aa7dd29 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:45:32.108024 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1f885bef-a74a-411b-9429-ac931aa7dd29 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:32.108569 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1f885bef-a74a-411b-9429-ac931aa7dd29 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:32.109414 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1f885bef-a74a-411b-9429-ac931aa7dd29 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:32.109959 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1f885bef-a74a-411b-9429-ac931aa7dd29 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:32.140322 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1f885bef-a74a-411b-9429-ac931aa7dd29 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:32.142075 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-1f885bef-a74a-411b-9429-ac931aa7dd29 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:32.142075 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-1f885bef-a74a-411b-9429-ac931aa7dd29 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lazy-loading 'fault' on Instance uuid 0552e2ca-104c-4100-ac8c-aa9ea0460cd4 {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:45:32.183077 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-1f885bef-a74a-411b-9429-ac931aa7dd29 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:45:32.190206 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-1f885bef-a74a-411b-9429-ac931aa7dd29 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 200 len: 1230 microversion: 2.1 time: 0.093927 Sep 24 03:45:32.190764 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 588/1181] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:45:32 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:45:33.207813 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2f0c9f92-380b-4815-8105-a2818e5185ef tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:45:33.208435 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-2f0c9f92-380b-4815-8105-a2818e5185ef tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 0552e2ca-104c-4100-ac8c-aa9ea0460cd4] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:45:33.214501 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f0c9f92-380b-4815-8105-a2818e5185ef tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:33.214948 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f0c9f92-380b-4815-8105-a2818e5185ef tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:33.215712 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f0c9f92-380b-4815-8105-a2818e5185ef tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:33.216141 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-2f0c9f92-380b-4815-8105-a2818e5185ef tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:33.230193 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-2f0c9f92-380b-4815-8105-a2818e5185ef tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] HTTP exception thrown: Instance 0552e2ca-104c-4100-ac8c-aa9ea0460cd4 could not be found. Sep 24 03:45:33.230768 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-2f0c9f92-380b-4815-8105-a2818e5185ef tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Returning 404 to user: Instance 0552e2ca-104c-4100-ac8c-aa9ea0460cd4 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:45:33.231568 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-2f0c9f92-380b-4815-8105-a2818e5185ef tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4" status: 404 len: 111 microversion: 2.1 time: 0.028385 Sep 24 03:45:33.232115 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 594/1182] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:45:33 2021] GET /compute/v2.1/servers/0552e2ca-104c-4100-ac8c-aa9ea0460cd4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:45:36.521503 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-91a29ab1-a997-45c2-af18-b630c470558b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:45:36.522233 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-91a29ab1-a997-45c2-af18-b630c470558b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:45:36.524152 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-118207f1-342d-492b-83b0-37678a77f046 req-ba0d6726-068c-443a-8dc1-d46c377f9105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987027b6-5096-480c-ba2a-8536b27fe070", "tag": "03ed0ec4-0b4c-409a-97e8-50682cefa193"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:45:36.525738 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:45:36.525738 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:45:36.528101 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-91a29ab1-a997-45c2-af18-b630c470558b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:36.528540 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-91a29ab1-a997-45c2-af18-b630c470558b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:36.529474 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-91a29ab1-a997-45c2-af18-b630c470558b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:36.529927 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-91a29ab1-a997-45c2-af18-b630c470558b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:36.533113 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-118207f1-342d-492b-83b0-37678a77f046 req-ba0d6726-068c-443a-8dc1-d46c377f9105 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:36.533542 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-118207f1-342d-492b-83b0-37678a77f046 req-ba0d6726-068c-443a-8dc1-d46c377f9105 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:36.544634 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-118207f1-342d-492b-83b0-37678a77f046 req-ba0d6726-068c-443a-8dc1-d46c377f9105 service nova] Creating event network-changed:03ed0ec4-0b4c-409a-97e8-50682cefa193 for instance 987027b6-5096-480c-ba2a-8536b27fe070 on hv-cinder-81080 Sep 24 03:45:36.549896 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-118207f1-342d-492b-83b0-37678a77f046 req-ba0d6726-068c-443a-8dc1-d46c377f9105 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029342 Sep 24 03:45:36.551329 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 595/1183] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:45:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:45:36.556064 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-91a29ab1-a997-45c2-af18-b630c470558b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Going to try to terminate instance {{(pid=109375) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 24 03:45:36.645794 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-91a29ab1-a997-45c2-af18-b630c470558b tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "DELETE /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 204 len: 0 microversion: 2.1 time: 0.127716 Sep 24 03:45:36.646628 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 589/1184] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:45:36 2021] DELETE /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 03:45:36.655476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-ef6df67d-97a3-4ca3-9214-faccf540eb73 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:45:36.656176 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-ef6df67d-97a3-4ca3-9214-faccf540eb73 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:45:36.662228 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ef6df67d-97a3-4ca3-9214-faccf540eb73 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:36.662672 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ef6df67d-97a3-4ca3-9214-faccf540eb73 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:36.663442 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ef6df67d-97a3-4ca3-9214-faccf540eb73 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:36.663868 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-ef6df67d-97a3-4ca3-9214-faccf540eb73 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:36.870453 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.policy [None req-ef6df67d-97a3-4ca3-9214-faccf540eb73 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109374) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:45:36.878145 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-ef6df67d-97a3-4ca3-9214-faccf540eb73 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1579 microversion: 2.1 time: 0.226733 Sep 24 03:45:36.878712 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 596/1185] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:45:36 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1579 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:45:37.896196 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-4241f499-22be-48a1-bc08-e9cca0b3e588 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:45:37.896897 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-4241f499-22be-48a1-bc08-e9cca0b3e588 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:45:37.902894 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4241f499-22be-48a1-bc08-e9cca0b3e588 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:37.903335 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4241f499-22be-48a1-bc08-e9cca0b3e588 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:37.904106 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4241f499-22be-48a1-bc08-e9cca0b3e588 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:37.904534 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-4241f499-22be-48a1-bc08-e9cca0b3e588 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:38.025891 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-4241f499-22be-48a1-bc08-e9cca0b3e588 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:45:38.033565 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-4241f499-22be-48a1-bc08-e9cca0b3e588 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1460 microversion: 2.1 time: 0.142119 Sep 24 03:45:38.034348 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 590/1186] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:45:37 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1460 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:45:38.596672 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [req-5e55483c-c967-4e05-a3c3-d52358da16d2 req-99ef72bb-c77d-4d28-b4cf-7e7adc9608a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987027b6-5096-480c-ba2a-8536b27fe070", "name": "network-vif-deleted", "tag": "03ed0ec4-0b4c-409a-97e8-50682cefa193"}]} {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 03:45:38.599294 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 03:45:38.599294 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: warnings.warn(msg) Sep 24 03:45:38.608934 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-5e55483c-c967-4e05-a3c3-d52358da16d2 req-99ef72bb-c77d-4d28-b4cf-7e7adc9608a6 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:38.609388 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [req-5e55483c-c967-4e05-a3c3-d52358da16d2 req-99ef72bb-c77d-4d28-b4cf-7e7adc9608a6 service nova] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:38.622261 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.compute.server_external_events [req-5e55483c-c967-4e05-a3c3-d52358da16d2 req-99ef72bb-c77d-4d28-b4cf-7e7adc9608a6 service nova] Creating event network-vif-deleted:03ed0ec4-0b4c-409a-97e8-50682cefa193 for instance 987027b6-5096-480c-ba2a-8536b27fe070 on hv-cinder-81080 Sep 24 03:45:38.627476 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [req-5e55483c-c967-4e05-a3c3-d52358da16d2 req-99ef72bb-c77d-4d28-b4cf-7e7adc9608a6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036073 Sep 24 03:45:38.628057 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 597/1187] 10.222.0.18 () {64 vars in 1318 bytes} [Fri Sep 24 03:45:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 03:45:39.050291 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-b3f05ab2-7f3c-42bc-9e76-632852f47ed5 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:45:39.051620 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-b3f05ab2-7f3c-42bc-9e76-632852f47ed5 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:45:39.057679 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b3f05ab2-7f3c-42bc-9e76-632852f47ed5 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:39.058105 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b3f05ab2-7f3c-42bc-9e76-632852f47ed5 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:39.058866 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b3f05ab2-7f3c-42bc-9e76-632852f47ed5 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:39.059294 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b3f05ab2-7f3c-42bc-9e76-632852f47ed5 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:39.089442 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b3f05ab2-7f3c-42bc-9e76-632852f47ed5 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:39.089916 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-b3f05ab2-7f3c-42bc-9e76-632852f47ed5 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:39.090364 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.objects.instance [None req-b3f05ab2-7f3c-42bc-9e76-632852f47ed5 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lazy-loading 'fault' on Instance uuid 987027b6-5096-480c-ba2a-8536b27fe070 {{(pid=109375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 24 03:45:39.130654 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.policy [None req-b3f05ab2-7f3c-42bc-9e76-632852f47ed5 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee5b6094e3b48739df3c797dfcc4edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfe51f1a692492e80a0c7c5a9078e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=109375) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 03:45:39.137925 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-b3f05ab2-7f3c-42bc-9e76-632852f47ed5 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 200 len: 1231 microversion: 2.1 time: 0.091248 Sep 24 03:45:39.138495 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 591/1188] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:45:39 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 1231 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 03:45:40.155093 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d9e27b10-96dd-4fc9-baf6-873e3b1bcde7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:45:40.155772 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-d9e27b10-96dd-4fc9-baf6-873e3b1bcde7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 987027b6-5096-480c-ba2a-8536b27fe070] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:45:40.162052 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d9e27b10-96dd-4fc9-baf6-873e3b1bcde7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:40.162427 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d9e27b10-96dd-4fc9-baf6-873e3b1bcde7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:40.163176 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d9e27b10-96dd-4fc9-baf6-873e3b1bcde7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:40.163597 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-d9e27b10-96dd-4fc9-baf6-873e3b1bcde7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:40.177191 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-d9e27b10-96dd-4fc9-baf6-873e3b1bcde7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] HTTP exception thrown: Instance 987027b6-5096-480c-ba2a-8536b27fe070 could not be found. Sep 24 03:45:40.177810 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-d9e27b10-96dd-4fc9-baf6-873e3b1bcde7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Returning 404 to user: Instance 987027b6-5096-480c-ba2a-8536b27fe070 could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:45:40.178609 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-d9e27b10-96dd-4fc9-baf6-873e3b1bcde7 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070" status: 404 len: 111 microversion: 2.1 time: 0.027610 Sep 24 03:45:40.179124 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 598/1189] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:45:40 2021] GET /compute/v2.1/servers/987027b6-5096-480c-ba2a-8536b27fe070 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:45:40.610495 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-11c5a945-cc66-4357-b0bb-9b03c87209f1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:45:40.610981 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.compute.api [None req-11c5a945-cc66-4357-b0bb-9b03c87209f1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109375) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:45:40.617550 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-11c5a945-cc66-4357-b0bb-9b03c87209f1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:40.618029 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-11c5a945-cc66-4357-b0bb-9b03c87209f1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:40.618799 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-11c5a945-cc66-4357-b0bb-9b03c87209f1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:40.619230 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG oslo_concurrency.lockutils [None req-11c5a945-cc66-4357-b0bb-9b03c87209f1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:40.632408 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.wsgi [None req-11c5a945-cc66-4357-b0bb-9b03c87209f1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] HTTP exception thrown: Instance 4965e258-30ca-4b70-ab5a-9f78a973c53d could not be found. Sep 24 03:45:40.632989 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-11c5a945-cc66-4357-b0bb-9b03c87209f1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Returning 404 to user: Instance 4965e258-30ca-4b70-ab5a-9f78a973c53d could not be found. {{(pid=109375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:45:40.633830 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-11c5a945-cc66-4357-b0bb-9b03c87209f1 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 404 len: 111 microversion: 2.1 time: 0.026997 Sep 24 03:45:40.634390 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 592/1190] 10.222.0.18 () {58 vars in 1239 bytes} [Fri Sep 24 03:45:40 2021] DELETE /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:45:40.642021 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8cb346cf-81c2-444c-b769-67473e4f04c6 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '>' {{(pid=109374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:45:40.642621 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.compute.api [None req-8cb346cf-81c2-444c-b769-67473e4f04c6 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] [instance: 4965e258-30ca-4b70-ab5a-9f78a973c53d] Fetching instance by UUID {{(pid=109374) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 24 03:45:40.648385 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8cb346cf-81c2-444c-b769-67473e4f04c6 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:40.648824 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8cb346cf-81c2-444c-b769-67473e4f04c6 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:40.649576 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8cb346cf-81c2-444c-b769-67473e4f04c6 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 24 03:45:40.650034 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG oslo_concurrency.lockutils [None req-8cb346cf-81c2-444c-b769-67473e4f04c6 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Lock "05fe9a5b-3028-4ccf-ab58-a247bdca46d5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 24 03:45:40.663370 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.wsgi [None req-8cb346cf-81c2-444c-b769-67473e4f04c6 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] HTTP exception thrown: Instance 4965e258-30ca-4b70-ab5a-9f78a973c53d could not be found. Sep 24 03:45:40.663935 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: DEBUG nova.api.openstack.wsgi [None req-8cb346cf-81c2-444c-b769-67473e4f04c6 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Returning 404 to user: Instance 4965e258-30ca-4b70-ab5a-9f78a973c53d could not be found. {{(pid=109374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 24 03:45:40.664719 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO nova.api.openstack.requestlog [None req-8cb346cf-81c2-444c-b769-67473e4f04c6 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d" status: 404 len: 111 microversion: 2.1 time: 0.026379 Sep 24 03:45:40.665220 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: [pid: 109374|app: 0|req: 599/1191] 10.222.0.18 () {58 vars in 1236 bytes} [Fri Sep 24 03:45:40 2021] GET /compute/v2.1/servers/4965e258-30ca-4b70-ab5a-9f78a973c53d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 03:45:41.954189 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: DEBUG nova.api.openstack.wsgi [None req-aacf8be2-0232-418f-a40b-86a752ab7193 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] Calling method '.version_select at 0x7f66640f6f70>' {{(pid=109375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 03:45:41.980166 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO nova.api.openstack.requestlog [None req-aacf8be2-0232-418f-a40b-86a752ab7193 tempest-TestVolumeBootPattern-394076301 tempest-TestVolumeBootPattern-394076301-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1127999244" status: 202 len: 0 microversion: 2.1 time: 0.029630 Sep 24 03:45:41.980697 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: [pid: 109375|app: 0|req: 593/1192] 10.222.0.18 () {58 vars in 1263 bytes} [Fri Sep 24 03:45:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1127999244 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 03:46:18.826517 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 03:46:18.827179 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: Fri Sep 24 03:46:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 24 03:48:05.313435 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 03:48:05.314065 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: Fri Sep 24 03:48:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 24 03:48:17.578204 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 03:48:17.578872 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: Fri Sep 24 03:48:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 24 03:48:25.609074 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 03:48:25.609700 dv-cinder-810800-1-iscsi devstack@n-api.service[109374]: Fri Sep 24 03:48:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 24 03:48:41.140583 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 03:48:41.141097 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: Fri Sep 24 03:48:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 24 03:49:38.844760 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 03:49:38.845494 dv-cinder-810800-1-iscsi devstack@n-api.service[109375]: Fri Sep 24 03:49:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!